3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 312 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Process local: 6
Input Size / Records:
0.0 B / 28
Associated Job Ids:
167
DAG Visualization
digraph G { subgraph clusterstage_312 { label="Stage 312"; subgraph cluster2247 { label="Scan parquet "; 846 [labelType="html" label="FileScanRDD [846]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 847 [labelType="html" label="MapPartitionsRDD [847]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2242 { label="WholeStageCodegen (1)"; 848 [labelType="html" label="MapPartitionsRDD [848]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2254 { label="Scan json "; 849 [labelType="html" label="FileScanRDD [849]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 850 [labelType="html" label="MapPartitionsRDD [850]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2250 { label="WholeStageCodegen (2)"; 851 [labelType="html" label="MapPartitionsRDD [851]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2241 { label="Union"; 852 [labelType="html" label="UnionRDD [852]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2255 { label="mapPartitionsInternal"; 853 [labelType="html" label="MapPartitionsRDD [853]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 846->847; 847->848; 849->850; 850->851; 848->852; 851->852; 852->853; }
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time