Skip to content

oleksandrabovkun/spark-ui-simulator-experiments

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
Data-Factory
Data-Factory
 
 
Exp #3542 - Join
Exp #3542 - Join
 
 
Exp #3799 - Join-Filter
Exp #3799 - Join-Filter
 
 
Exp #5287 - Persist
Exp #5287 - Persist
 
 
Labs
Labs
 
 
WIP
WIP
 
 
_Archive
_Archive
 
 
Exp #0000-P - Exploring the Spark UI.py
Exp #0000-P - Exploring the Spark UI.py
 
 
Exp #0000-S - Exploring the Spark UI.scala
Exp #0000-S - Exploring the Spark UI.scala
 
 
Exp #1241-S - maxPartitionBytes.scala
Exp #1241-S - maxPartitionBytes.scala
 
 
Exp #1242-S - openCostInBytes.scala
Exp #1242-S - openCostInBytes.scala
 
 
Exp #1337-S - Z-Order Haystack Query.scala
Exp #1337-S - Z-Order Haystack Query.scala
 
 
Exp #1596-S - Skew Joins.scala
Exp #1596-S - Skew Joins.scala
 
 
Exp #2163-S - IO Cache.scala
Exp #2163-S - IO Cache.scala
 
 
Exp #2586-P - Manual Compaction.py
Exp #2586-P - Manual Compaction.py
 
 
Exp #2586-S - Manual Compaction.scala
Exp #2586-S - Manual Compaction.scala
 
 
Exp #2653-S - Shuffle Partitions.scala
Exp #2653-S - Shuffle Partitions.scala
 
 
Exp #2934-S - Predicate Pushdown Comparison.scala
Exp #2934-S - Predicate Pushdown Comparison.scala
 
 
Exp #2935-P - Predicate Pushdown.py
Exp #2935-P - Predicate Pushdown.py
 
 
Exp #4112-S - Columnar Reads.scala
Exp #4112-S - Columnar Reads.scala
 
 
Exp #4538-P - UDFs.py
Exp #4538-P - UDFs.py
 
 
Exp #4538-S - UDFs.scala
Exp #4538-S - UDFs.scala
 
 
Exp #5980-PS - Benchmarking.scala
Exp #5980-PS - Benchmarking.scala
 
 
Exp #6167-S - Bucket Join.scala
Exp #6167-S - Bucket Join.scala
 
 
Exp #6518-S - Spill.scala
Exp #6518-S - Spill.scala
 
 
Exp #6732-S - Producing Bucketed Datasets.scala
Exp #6732-S - Producing Bucketed Datasets.scala
 
 
Exp #8342-S - Predicate Pushdown.scala
Exp #8342-S - Predicate Pushdown.scala
 
 
Exp #8357-S - Tuning JDBC.scala
Exp #8357-S - Tuning JDBC.scala
 
 
Exp #8923-S - Read Tiny Files.scala
Exp #8923-S - Read Tiny Files.scala
 
 
Exp #8973-S - Scanning.scala
Exp #8973-S - Scanning.scala
 
 
Exp #9156-S - Hash Partitioning Skew-n-Spill.scala
Exp #9156-S - Hash Partitioning Skew-n-Spill.scala
 
 
README.md
README.md
 
 
_READ_ME.scala
_READ_ME.scala
 
 

Repository files navigation

Spark UI Simulator Experiments

This repo contains all the source notebooks for the various experiments.

For more information, please reach out to: Jacob D. Parr [email protected] (non-preferred) slack (preferred)

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

4 stars

Watchers

1 watching

Forks

17 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages