Building Big Data Pipelines with SparkR & PowerBI & MongoDB

Welcome to the Building Big Data Pipelines with SparkR & PowerBI & MongoDB course. In this course we will be creating a big data analytics solution using big data technologies for R.

In our use case we will be working with raw earthquake data and  we will be applying big data processing techniques to extract transform and load the data into usable datasets. Once we have processed and cleaned the data, we will use it as a data source for building predictive analytics and visualizations.

Power BI Desktop is a powerful data visualization tool that lets you build advanced queries, models and reports. With Power BI Desktop, you can connect to multiple data sources and combine them into a data model. This data model lets you build visuals, and dashboards that you can share as reports with other people in your organization.

SparkRis an R package that provides a light-weight frontend to use Apache Spark from R. SparkR provides a distributed data frame implementation that supports operations like selection, filtering, aggregation etc. (similar to R data frames, dplyr) but on large datasets. SparkR also supports distributed machine learning using MLlib.

MongoDBis a document-oriented NoSQLdatabase, used for high volume data storage. It stores data in JSON like format called documents, and does not use row/column tables. The document model maps to the objects in your application code, making the data easy to work with.

• You will learn how to create big data processing pipelines using R and MongoDB

• You will learn machine learning with geospatial data using the SparkR and the MLlib library

• You will learn data analysis using SparkR, R and PowerBI

• You will learn how to manipulate, clean and transform data using Spark dataframes

• You will learn how to create Geo Maps in PowerBI Desktop

• You will also learn how to create dashboards in PowerBI Desktop

Rating Distribution

• 1 stars: 0 votes
• 2 stars: 0 votes
• 3 stars: 1 votes
• 4 stars: 2 votes
• 5 stars: 1 votes

Frequently Asked Questions

How long do I have access to the course materials?

You can view and review the lecture materials indefinitely, like an on-demand channel.

Can I take my courses with me wherever I go?

Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don’t have an internet connection, some instructors also let their students download course lectures. That’s up to the instructor though, so make sure you get on their good side!