What is Data Pipeline? | Why Is It So Popular?

88,885
0
Published 2024-06-11
Get a Free System Design PDF with 158 pages by subscribing to our weekly newsletter: bit.ly/bytebytegoytTopic

Animation tools: Adobe Illustrator and After Effects.

Checkout our bestselling System Design Interview books:
Volume 1: amzn.to/3Ou7gkd
Volume 2: amzn.to/3HqGozy

The digital version of System Design Interview books: bit.ly/3mlDSk9

ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

All Comments (21)
  • Amazing explanation, so far the most easy to digest video about data pipelines.
  • @mrseanpaul81
    I love the short video format, as I can dive deeper on topics and terms I am interested in on my own time :)
  • @atomtamadas
    Spark is widely used in stream processing too, not only batch, see spark structured streaming.
  • @gus473
    💯 Looking like your channel is on track for 1 million subscribers by year end! Great stuff! 😎✌️
  • @ttehir
    Why do we mostly talk about data pipelines for BI or ML when many times we also need it for functional applications?
  • @ChrisPatt
    Loved how simply you explained this complicated concept! Also what are your thoughts on Irys, world's only provenance layer ensuring the data integrity and accountability.
  • @virtuoso_hub
    I like your presentations. What do you use to make them?
  • @chrisc9725
    Fantastic video and graphics, what program do you use to animate your graphics? It's great stuff.
  • @vlplbl85
    Great video. Small remark: the AWS service for ETL is called AWS Glue, not Glow
  • @bladethirst1
    Maybe some examples of simplified pipeline on specific application would make this video even better.