4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 94659 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 20
Input Size / Records:
0.0 B / 34
Shuffle Write Size / Records:
38.2 KiB / 34
Associated Job Ids:
7094
DAG Visualization
digraph G { id="graph_94659"; subgraph graph_stage_94659 { id="graph_stage_94659"; isCluster="true"; label="Stage 94659"; subgraph cluster_133090 { id="cluster_133090"; isCluster="true"; label="Scan parquet "; 51557 [id="node_51557" labelType="html" label="FileScanRDD [51557]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 51558 [id="node_51558" labelType="html" label="MapPartitionsRDD [51558]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_133085 { id="cluster_133085"; isCluster="true"; label="WholeStageCodegen (1)"; 51559 [id="node_51559" labelType="html" label="MapPartitionsRDD [51559]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_133084 { id="cluster_133084"; isCluster="true"; label="Exchange"; 51560 [id="node_51560" labelType="html" label="MapPartitionsRDD [51560]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 51557->51558; 51558->51559; 51559->51560; }
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time