Ranga Reddy Software Engineer

Spark Configuration Generator tool

2021-12-29
Ranga Reddy

Spark Configuration Generator

Spark Configuration Generator tool will generate the spark configuration based on hardware configuration.

Spark Configuration Generator
Hardware Configuration
Name Value
Spark Configuration Approches
Executor Approch Type Executor Cores
(spark.executor.cores)
Number of Executors
(spark.executor.instances)
Executor Memory in GB
(spark.executor.memory)
Executor Memory Overhead in GB
(spark.executor.memoryOverhead)
Balanced Approach Spark Shell Command


If you liked this post, you can also donate me for a coffee, and I'll do better. Thanks.

PayPal
PayPal
Donate via PayPal

Similar Posts

Previous Spark submit Proxy host/port configuration

Next Epoch & Unix Timestamp Converter Tools

Content