3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 185 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Process local: 9
Input Size / Records:
0.0 B / 46
Associated Job Ids:
89
DAG Visualization
digraph G { subgraph clusterstage_185 { label="Stage 185"; subgraph cluster1196 { label="Scan parquet "; 462 [labelType="html" label="FileScanRDD [462]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 463 [labelType="html" label="MapPartitionsRDD [463]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1189 { label="WholeStageCodegen (1)"; 464 [labelType="html" label="MapPartitionsRDD [464]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1201 { label="Scan json "; 465 [labelType="html" label="FileScanRDD [465]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 466 [labelType="html" label="MapPartitionsRDD [466]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1197 { label="WholeStageCodegen (2)"; 467 [labelType="html" label="MapPartitionsRDD [467]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1188 { label="Union"; 468 [labelType="html" label="UnionRDD [468]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1202 { label="mapPartitionsInternal"; 469 [labelType="html" label="MapPartitionsRDD [469]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 462->463; 463->464; 465->466; 466->467; 464->468; 467->468; 468->469; }
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time