3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 236 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 10
Input Size / Records:
0.0 B / 35
Shuffle Write Size / Records:
17.4 KiB / 35
Associated Job Ids:
121
DAG Visualization
digraph G { subgraph clusterstage_236 { label="Stage 236"; subgraph cluster1658 { label="Scan parquet "; 618 [labelType="html" label="FileScanRDD [618]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 619 [labelType="html" label="MapPartitionsRDD [619]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1654 { label="WholeStageCodegen (1)"; 620 [labelType="html" label="MapPartitionsRDD [620]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1662 { label="Scan json "; 621 [labelType="html" label="FileScanRDD [621]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 622 [labelType="html" label="MapPartitionsRDD [622]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1659 { label="WholeStageCodegen (2)"; 623 [labelType="html" label="MapPartitionsRDD [623]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1653 { label="Union"; 624 [labelType="html" label="UnionRDD [624]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1652 { label="Exchange"; 625 [labelType="html" label="MapPartitionsRDD [625]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 618->619; 619->620; 621->622; 622->623; 620->624; 623->624; 624->625; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time