Data Engineering - Projects
Apache Spark End-To-End Data Engineering Project
In this video, we used DataBricks to create multiple ETL pipelines using the Python API of Apache Spark i.e. PySpark. We used sources like CSV, Parquet, and Delta Table & Factory Pattern to make the reader class.
We used PySpark DataFrame API and Spark SQL to write the
business transformation logic.
In the loader part, we have used DataLake and LakeHouse as target.
Sports Data Analysis using PySpark - Part 01
Dive into the world of big data processing with our PySpark Practice playlist. This series is designed for both beginners and seasoned data professionals looking to sharpen their Apache Spark skills through scenario-based questions and challenges. Each video provides step-by-step solutions to real-world problems, helping you master PySpark techniques and improve your data-handling capabilities.
Sports Data Analysis using PySpark - Part 02
This video focuses on the practical aspect of learning PySpark by hands-on coding firstly using SQL to solve the problem & then solving the same problem using PySpark.
Data Engineering - Mock Interview Series
Data Engineering Mock Interview | Myntra
Explore a skilled Data Engineer's insights into real-time data processing and engineering, covering techniques, tools, and technologies such as Apache Spark, Kafka, Airflow, and AWS in this essential mock interview resource for career development.
The Art of Real-Time Data Engineering: Exclusive Interview with a Skilled Developer
An engaging video featuring a mock interview with an experienced Data Engineer, delving into their expertise in real-time streaming pipeline development, covering techniques, tools, and technologies such as Apache Kafka and Spark Streaming, offering valuable insights for both beginners and seasoned professionals in the field of data engineering.
Data Engineering Second Round of Mock Interview
A video featuring a mock interview with an experienced Data Engineer, exploring their techniques and technologies, providing valuable insights for both aspiring and seasoned professionals in the field of real-time data processing and engineering.
First round of Data Engineering Interview | Product Based Companies | Ecom Express Limited | Walmart
Mock interview for Data Engineering role with Sanyam Jain from Ecom Express, covering Big Data, SQL, and basic Data Structure questions, aimed at aiding preparation for Data Engineering or Big Data interviews.
First Round | Walmart | XpressBees
Mock interview with Nikhil Gupta, Senior Data Engineer at XpressBees, covering SQL and basic Data Structure for those preparing for Data Engineering or Big Data interviews.
First Round | Product Based Companies
A mock interview for the Data Engineering role featuring Akash Dhal, focusing on SQL and basic Data Structure, aimed at aiding preparation for Data Engineering or Big Data interviews.
Data Engineering Interview | Product-Based Companies
Mock interview with a seasoned Data Architect with over 16 years of experience for a Data Engineering role in the USA.
Interview: First round of Data Engineering Mock Interview
An engaging video features a mock interview with a skilled Data Engineer, exploring their use of advanced techniques and technologies, providing valuable insights for both beginners and experienced professionals in the dynamic field of data engineering.
Data Engineering Mock Interview | Round one
A video featuring a mock interview with a skilled Data Engineer, exploring their techniques and tools, including insights from expert interviewer Nisha, providing valuable advice for both aspiring and experienced data engineers.
Interview: First round of Data Engineering Mock Interview
Participate in a Data Engineering mock interview with Shakti Naik, an 8+ years experienced professional, offering valuable insights and guidance on topics like Apache Spark, SQL, Airflow, ETL pipelines, and more to enhance your interview skills.
Do check all other Data Engineering Mock Interview videos on our YouTube channel.
The Big Data Show
Women In Tech - Series
From Asia to Netflix - Insight from Senior Data Engineer
Xinran Waibel, Senior Data Engineer at Netflix, shares insights on data engineering, discussing her 7 years of industry experience, challenges faced, and secrets to building successful data infrastructure in an engaging and inspiring talk.
Software Developer to Head of Engineering at Microsoft
This podcast features Isha Rani, Head of Engineering at Microsoft, discussing her tech career journey, challenges, roles, and insights on the industry's shift towards private and on-premise cloud solutions, offering advice for women pursuing tech careers.
How Data Engineer power product like Alex | Amazon
Rohini Basu, a Senior Data Engineer with nearly 11 years of experience, is currently based in Seattle, USA, working at Amazon's office.
Non-IT background to Data Engineering content creator and mentor
Priya Chauhan, a Data Engineering content creator and mentor. She has near to 4 years of industry experience
SDE II at Microsoft
Kumari Prerna, a SDE-II with close to 5 Year of experience.
This website uses cookies.
We use cookies to analyze website traffic and optimize your website experience. By accepting our use of cookies, your data will be aggregated with all other user data.