3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 319 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 5
Input Size / Records:
0.0 B / 27
Shuffle Write Size / Records:
17.9 KiB / 27
Associated Job Ids:
173
DAG Visualization
digraph G { subgraph clusterstage_319 { label="Stage 319"; subgraph cluster2375 { label="Scan parquet "; 889 [labelType="html" label="FileScanRDD [889]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 890 [labelType="html" label="MapPartitionsRDD [890]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2371 { label="WholeStageCodegen (1)"; 891 [labelType="html" label="MapPartitionsRDD [891]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2379 { label="Scan json "; 892 [labelType="html" label="FileScanRDD [892]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 893 [labelType="html" label="MapPartitionsRDD [893]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2376 { label="WholeStageCodegen (2)"; 894 [labelType="html" label="MapPartitionsRDD [894]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2370 { label="Union"; 895 [labelType="html" label="UnionRDD [895]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2369 { label="Exchange"; 896 [labelType="html" label="MapPartitionsRDD [896]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 889->890; 890->891; 892->893; 893->894; 891->895; 894->895; 895->896; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time