3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 5 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 6
Input Size / Records:
0.0 B / 28
Shuffle Write Size / Records:
18.9 KiB / 28
Associated Job Ids:
5
DAG Visualization
digraph G { subgraph clusterstage_5 { label="Stage 5"; subgraph cluster80 { label="Scan parquet "; 26 [labelType="html" label="FileScanRDD [26]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 27 [labelType="html" label="MapPartitionsRDD [27]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster76 { label="WholeStageCodegen (1)"; 28 [labelType="html" label="MapPartitionsRDD [28]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster84 { label="Scan json "; 29 [labelType="html" label="FileScanRDD [29]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 30 [labelType="html" label="MapPartitionsRDD [30]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster81 { label="WholeStageCodegen (2)"; 31 [labelType="html" label="MapPartitionsRDD [31]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster75 { label="Union"; 32 [labelType="html" label="UnionRDD [32]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster74 { label="Exchange"; 33 [labelType="html" label="MapPartitionsRDD [33]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 26->27; 27->28; 29->30; 30->31; 28->32; 31->32; 32->33; }
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time