Open in app

Sign In

Write

Sign In

Shubham Dangare
Shubham Dangare

3 Followers

Home

About

Jun 24, 2021

Starter kit for apache beam

Apache Beam is an open source, unified model for defining both batch and streaming data-parallel processing pipelines. Beam’s supported distributed processing back-ends, which include Apache Flink, Apache Spark, and Google Cloud Dataflow. It is Data Processing platform mainly used fro analytics or for ETL which is execution platform agnostics …

Beat Tutorials

3 min read

Starter kit for apache beam
Starter kit for apache beam
Beat Tutorials

3 min read


Jun 23, 2021

Serverless Slack Bot with GCP

Slack Bot integration serverless using GCP cloud function In this post, I’ll show you how I built a Slack Bot with Python. In addition, I’ll show you how to overcome a common issue when working with APIs and how a unique Cloud Functions pattern can help you overcome this obstacle. …

Gcp

3 min read

Serverless Slack Bot with GCP
Serverless Slack Bot with GCP
Gcp

3 min read


Nov 27, 2019

Apache Spark Streaming at it’s Best

Apache Spark Streaming is a scalable fault-tolerant streaming processing system that natively supports both batch and streaming workloads. Spark Streaming is different from other systems that either have a processing engine designed only for streaming, or have similar batch and streaming APIs but compile internally to different engines. Spark’s single…

Big Data

3 min read

Apache Spark Streaming at it
Apache Spark Streaming at it
Big Data

3 min read


Nov 27, 2019

KSQL is a SQL streaming engine for Apache Kafka

It provides an easy-to-use, yet powerful interactive SQL interface for stream processing on Kafka, without the need to write code in a programming language such as Java or Python. …

Big Data

2 min read

Big Data

2 min read


Nov 27, 2019

Getting Started With Spark Basics

Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala, Python and R, and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools including Spark SQL for SQL and structured data processing, MLib for machine…

Spark

4 min read

Getting Started With Spark Basics
Getting Started With Spark Basics
Spark

4 min read

Shubham Dangare

Shubham Dangare

3 Followers

Data Engineer at Cloud Cover

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech