3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 351 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Process local: 9
Input Size / Records:
0.0 B / 32
Shuffle Write Size / Records:
16.2 KiB / 32
Associated Job Ids:
193
DAG Visualization
digraph G { subgraph clusterstage_351 { label="Stage 351"; subgraph cluster2644 { label="Scan parquet "; 985 [labelType="html" label="FileScanRDD [985]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 986 [labelType="html" label="MapPartitionsRDD [986]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2640 { label="WholeStageCodegen (1)"; 987 [labelType="html" label="MapPartitionsRDD [987]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2648 { label="Scan json "; 988 [labelType="html" label="FileScanRDD [988]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 989 [labelType="html" label="MapPartitionsRDD [989]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2645 { label="WholeStageCodegen (2)"; 990 [labelType="html" label="MapPartitionsRDD [990]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2639 { label="Union"; 991 [labelType="html" label="UnionRDD [991]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster2638 { label="Exchange"; 992 [labelType="html" label="MapPartitionsRDD [992]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 985->986; 986->987; 988->989; 989->990; 987->991; 990->991; 991->992; }
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time