3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 39 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 9
Input Size / Records:
0.0 B / 32
Associated Job Ids:
26
DAG Visualization
digraph G { subgraph clusterstage_39 { label="Stage 39"; subgraph cluster382 { label="Scan parquet "; 135 [labelType="html" label="FileScanRDD [135]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 136 [labelType="html" label="MapPartitionsRDD [136]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster376 { label="WholeStageCodegen (1)"; 137 [labelType="html" label="MapPartitionsRDD [137]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster387 { label="Scan json "; 138 [labelType="html" label="FileScanRDD [138]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 139 [labelType="html" label="MapPartitionsRDD [139]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster383 { label="WholeStageCodegen (2)"; 140 [labelType="html" label="MapPartitionsRDD [140]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster374 { label="Union"; 141 [labelType="html" label="UnionRDD [141]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster388 { label="mapPartitionsInternal"; 142 [labelType="html" label="MapPartitionsRDD [142]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 135->136; 136->137; 138->139; 139->140; 137->141; 140->141; 141->142; }
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time