Data Pipelines Explained
141,471
Published 2022-06-16
Data is a lot like water; it often needs to be refined as it travels between a source and its final destination. That’s where data pipelines come in – they merge, filter, and summarize raw data, providing the end user with a clean product to analyze. Luv Aggarwal, a Data Solution Engineer at IBM, explains how several processes often embedded within data pipelines – like ETL, replication, virtualization, machine learning, and batch processing – help generate actionable business intelligence.
Get started with IBM Cloud free of charge → ibm.biz/BdPEPS
Subscribe to see more videos like this in the future → ibm.biz/subscribe-now
#Data #DataPipelines #DataAnalyses #DataIntegration #BusinessIntelligence #ETL
All Comments (21)
-
Now that's one of the best explanations with the simplest examples for data pipelines! Thank you
-
I would like to know how the Data Virtualization works. At first i thought that it is just "faking" a real data source in order to test data pipeline configuration?
-
Explained simply & effectively. I would like to see more elaborate content on big data & data science fields.
-
I think, Data Virtualization would be a great topic for the next educational video from this instructor.
-
Thank you very much, it was the most explanatory and beautifully explained video I've ever watched.
-
Nice video, just when you think you have heard it all, here comes "Data Virtualization". If possible that could be elaborated more.
-
Amazing simple explanation
-
Great explanation with easy to follow examples!
-
Very precise explanations with simple examples. 👏👏👏
-
Awesome Luv! You made it simple for the Sales guys.
-
Greatly explained. Easy to understand and clearly.
-
Hey dear, god bless your efforts in this channel. I have a general enquiry as a new sql learner. How could i create a pipeline to extract and load data from existing accounting program into our SQL server instances. How can i know if the export mechanism in the software permits me to undertake this extraction process, and how can i know if an application have an api? Thanks for taking care of my enquires. Looking forward to gain more knowledge from you
-
such a Quality content . Very well explained
-
Cant wait for data virtualization video.
-
I WILL IMPLEMENT STREAMING MACHINE LEARNING AT WORK VERY SOON
-
Nice analogy and explanation!
-
Greatly explained , would be more great if you could explain a few more processes to build pipelines in a breif
-
Data virtualization is something looks interesting
-
Wonderful video and explanation- I'm just trying to work out, if he's writing on glass, how is he able to write backwards so well- for us to view it as 'non reversed'. Edit: Got it- flipped video :)
-
I love these IBM videos. No organizations simplifies things the way they do.
