spark-sql

Apache Spark™ and Scala Workshops

Provides a cherrypy dashboard to bind access to Spark SQL.

End-to-end real-time credit card transactions application. Made with Kafka, Spark, Bootstrap, ECharts, RxJS.

Code from Ralph Winters book Packt/Practical-Predictive-Analytics

Ralph Winters Website

Recommendation System written in Python, using the pySpark framework and other Data Science libraries

Analysis for a streaming daily retail data using Spark structured streaming and querying this data to get insights

This project extracts list, information and statistics from Wikipedia articles of current and past NBA players. I used Spark SQL to extract information from html documents and save it to a csv file. In the nearby future, I will post the same objective achieved using Pig

Music prediction using PySpark

Capstone Project in the Udacity Data Scientist Nanodegree program. We manipulate large and realistic datasets with Spark to engineer relevant features for predicting churn. We'll learn how to use Spark MLlib to build machine learning models with large datasets, far beyond what could be done with non-distributed technologies like scikit-learn.

Sample analysis done using pyspark on parking violations issued for fiscal year 2017 using the databricks platform

Big Data Analytics for anazon.com using Spark Framework and Scala Programming Language

Created a SparkML RandomForest model to predict total employee compensation. Queried data with SparkSQL, ran PySpark scripts to run EDA, pre-process data, and train model achieving with 0.98 R2 score.

Felipe Altermann, Senior Data Analyst. Thanks for visiting my Portfolio!

Pipeline de Engenharia de Dados (Databricks Free Edition) para o SCANIA Component X Dataset: ingestão via Volumes, Delta Lake e arquitetura Medalhão (Bronze→Silver→Gold), modelagem em Esquema Estrela e dashboards/SQL para manutenção preditiva

Static landing site for Shuffle Works org.

An investigatory analysis of restaurant sales data using Apache Spark in an attempt to give some insights as to how to boost up the sales of less frequently sold items. This is a real-world dataset from an actual restaurant.