Spark Error Flowchart: Note this uses mermaid.js which may take awhile to load.

flowchart LR Error[Error/Exception] Error --> MemoryError[Memory Error] Error --> ShuffleError[Shuffle Error] Error --> SqlAnalysisError[sql.AnalysisException] Error --> WriteFails[WriteFails] Error --> OtherError[Others] OtherError --> SchemaColumnConvertNotSupportedException OtherError --> TooLargeJar[JAR too large] ShuffleError --> LostShuffleFiles[Lost Shuffle Files] ShuffleError --> ShuffleFetchCorrupted[Corrupted Shuffle Files] LostShuffleFiles --> ShuffleExchangeLosesExecReg[ShuffleExchange Loses Executor Registration] LostShuffleFiles --> NodeFailures[Node Failures] Error --> Serialization Serialization --> KyroBuffer[Kyro Buffer Overflow] Serialization --> MaxSerializeTask[Max serialized task size] KyroBuffer --> DriverMaxResultSize MemoryError --> DriverMemory[Driver] MemoryError --> ExecutorMemory[Executor] DriverMemory --> DriverMemoryError[Spark driver ran out of memory] DriverMemory --> DriverMaxResultSize[MaxResultSize exceeded] DriverMemory --> TooBigBroadcastJoin[Too Big Broadcast Join] DriverMemory --> ContainerOOM[Container Out Of Memory] DriverMaxResultSize --> TooBigBroadcastJoin ExecutorMemory --> ExecutorMemoryError[Spark executor ran out of memory] ExecutorMemory --> ExecutorDiskError[Executor out of disk error] ExecutorMemory --> ContainerOOM ExecutorMemory --> LARGERECORDS[Too large record / column+record] click ShuffleExchangeLosesExecReg "../../details/shuffle_exchange_loses_exec_reg" click MaxSerializeTask "../../details/max_serialized_task_size" click SchemaColumnConvertNotSupportedException "../../details/SchemaColumnConvertNotSupportedException" click TooLargeJar "../../details/toolargejar" click Error "../../details/error-job" click MemoryError "../../details/error-memory" click DriverMemory "../../details/error-memory/#driver" click DriverMemoryError "../../details/error-driver-out-of-memory" click DriverMaxResultSize "../../details/error-driver-max-result-size" click ExecutorMemory "../../details/error-memory/#executor" click ExecutorMemoryError "../../details/error-executor-out-of-memory" click ExecutorDiskError "../../details/error-executor-out-of-disk" click ShuffleError "../../details/error-shuffle" click ShuffleFetchCorrupted "../../details/shuffle_fetch_corrupted" click SqlAnalysisError "../../details/error-sql-analysis" click OtherError "../../details/error-other" click ContainerOOM "../../details/container-oom" click TooBigBroadcastJoin "../../details/big-broadcast-join" "Broadcast Joins" click LARGERECORDS "../../details/failure-executor-large-record" click WriteFails "../../details/write-fails"