3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 8 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 24
Shuffle Write Size / Records:
14.8 KiB / 24
Associated Job Ids:
7
DAG Visualization
digraph G { subgraph clusterstage_8 { label="Stage 8"; subgraph cluster140 { label="Scan parquet "; 47 [labelType="html" label="FileScanRDD [47]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 48 [labelType="html" label="MapPartitionsRDD [48]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster136 { label="WholeStageCodegen (1)"; 49 [labelType="html" label="MapPartitionsRDD [49]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster144 { label="Scan json "; 50 [labelType="html" label="FileScanRDD [50]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 51 [labelType="html" label="MapPartitionsRDD [51]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141 { label="WholeStageCodegen (2)"; 52 [labelType="html" label="MapPartitionsRDD [52]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster135 { label="Union"; 53 [labelType="html" label="UnionRDD [53]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster134 { label="Exchange"; 54 [labelType="html" label="MapPartitionsRDD [54]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 47->48; 48->49; 50->51; 51->52; 49->53; 52->53; 53->54; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time