3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 160 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 25
Associated Job Ids:
77
DAG Visualization
digraph G { subgraph clusterstage_160 { label="Stage 160"; subgraph cluster1035 { label="Exchange"; 401 [labelType="html" label="ShuffledRowRDD [401] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster1034 { label="InMemoryTableScan"; 402 [labelType="html" label="MapPartitionsRDD [402] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 403 [labelType="html" label="Exchange hashpartitioning(worklistShardItemId#11369L, 25), REPARTITION_BY_NUM, [plan_id=3775]\n+- *(2) HashAggregate(keys=[demandChannel#11372, shardId#11368, kpis#11374, version#11370, qty#11371, worklistShardItemId#11369L, demandStream#11373], functions=[], output=[shardId#11368, worklistShardItemId#11369L, version#11370, qty#11371, demandChannel#11372, demandStream#11373, kpis#11374])\n +- Exchange hashpartitioning(demandChannel#11372, shardId#11368, kpis#11374, version#11370, qty#11371, worklistShardItemId#11369L, demandStream#11373, 25), ENSURE_REQUIREMENTS, [plan_id=3771]\n +- HashAggregate(keys=[demandChannel#11372, shardId#11368, knownfloatingpointnormalized(transform(kpis#11374, lambdafunction(knownfloatingpointnormalized(if (isnull(lambda arg#13501)) null else named_struct(label, lambda arg#13501.label, dateTime, lambda arg#13501.dateTime, value, knownfloatingpointnormalized(normalizenanandzero(lambda arg#13501.value)))), lambda arg#13501, false))) AS kpis#11374, version#11370, knownfloatingp... [403] [Cached] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 404 [labelType="html" label="MapPartitionsRDD [404] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 405 [labelType="html" label="MapPartitionsRDD [405] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 406 [labelType="html" label="MapPartitionsRDD [406] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster1031 { label="WholeStageCodegen (1)"; 407 [labelType="html" label="MapPartitionsRDD [407] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster1030 { label="Exchange"; 408 [labelType="html" label="MapPartitionsRDD [408] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } } 401->402; 402->403; 403->404; 404->405; 405->406; 406->407; 407->408; }
400,401
403
Event Timeline
Enable zooming
Tasks: 25. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time