3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 497 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Process local: 9
Input Size / Records:
0.0 B / 46
Shuffle Write Size / Records:
35.5 KiB / 46
Associated Job Ids:
256
DAG Visualization
digraph G { subgraph clusterstage_497 { label="Stage 497"; subgraph cluster3458 { label="Scan parquet "; 1312 [labelType="html" label="FileScanRDD [1312]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 1313 [labelType="html" label="MapPartitionsRDD [1313]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3454 { label="WholeStageCodegen (1)"; 1314 [labelType="html" label="MapPartitionsRDD [1314]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3462 { label="Scan json "; 1315 [labelType="html" label="FileScanRDD [1315]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 1316 [labelType="html" label="MapPartitionsRDD [1316]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3459 { label="WholeStageCodegen (2)"; 1317 [labelType="html" label="MapPartitionsRDD [1317]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3453 { label="Union"; 1318 [labelType="html" label="UnionRDD [1318]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3452 { label="Exchange"; 1319 [labelType="html" label="MapPartitionsRDD [1319]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 1312->1313; 1313->1314; 1315->1316; 1316->1317; 1314->1318; 1317->1318; 1318->1319; }
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time