crp-order-qty-opt-service - Details for Query 3127

Submitted Time: 2026/08/10 09:36:28
Duration: 0.8 s
Succeeded Jobs: 4776 4777

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" AdaptiveSparkPlan " tooltip="AdaptiveSparkPlan isFinalPlan=true"]; subgraph cluster1 { isCluster="true"; id="cluster1"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n1 ms (0 ms, 0 ms, 1 ms (stage 61594.0: task 151615))"; tooltip="WholeStageCodegen (2)"; 2 [id="node2" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#732150, minOrderQtySettingInternal#732163, _extract_externalOrder#732173 AS externalOrder#732165, _extract_internalOrder#732174 AS internalOrder#732166, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#732175) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#732175 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#732175 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#732167]"]; } 3 [id="node3" labelType="html" label="Exchange shuffle records written: 1 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 84.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 48.0 B local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 84.0 B" tooltip="Exchange RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=291393]"]; subgraph cluster4 { isCluster="true"; id="cluster4"; label="WholeStageCodegen (1)\n \nduration: 137 ms"; tooltip="WholeStageCodegen (1)"; 5 [id="node5" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#732150, preferredUomSource#732159.distributionCenter.externalOrder AS _extract_externalOrder#732173, preferredUomSource#732159.distributionCenter.internalOrder AS _extract_internalOrder#732174, negligibleQuantitiesThreshold#732161.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]"]; 6 [id="node6" labelType="html" label="Filter number of output rows: 1" tooltip="Filter (marketUnit#732142 <=> Daily_grocery)"]; 7 [id="node7" labelType="html" label="ColumnarToRow number of output rows: 48 number of input batches: 1" tooltip="ColumnarToRow"]; } 8 [id="node8" labelType="html" label="Scan parquet number of files read: 1 scan time: 136 ms metadata time: 0 ms size of files read: 29.4 KiB number of output rows: 48" tooltip="FileScan parquet [marketUnit#732142,minOrderQtySetting#732150,preferredUomSource#732159,negligibleQuantitiesThreshold#732161,minOrderQtySettingInternal#732163] Batched: true, DataFilters: [(marketUnit#732142 <=> Daily_grocery)], Format: Parquet, Location: PreparedDeltaFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20...., PartitionFilters: [], PushedFilters: [EqualNullSafe(marketUnit,Daily_grocery)], ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:stru..."]; 2->0; 3->2; 5->3; 6->5; 7->6; 8->7; }

Details

== Physical Plan ==
AdaptiveSparkPlan (13)
+- == Final Plan ==
   ResultQueryStage (8), Statistics(sizeInBytes=8.0 EiB)
   +- * Project (7)
      +- ShuffleQueryStage (6), Statistics(sizeInBytes=48.0 B, rowCount=1)
         +- Exchange (5)
            +- * Project (4)
               +- * Filter (3)
                  +- * ColumnarToRow (2)
                     +- Scan parquet  (1)
+- == Initial Plan ==
   Project (12)
   +- Exchange (11)
      +- Project (10)
         +- Filter (9)
            +- Scan parquet  (1)


(1) Scan parquet 
Output [5]: [marketUnit#732142, minOrderQtySetting#732150, preferredUomSource#732159, negligibleQuantitiesThreshold#732161, minOrderQtySettingInternal#732163]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit]
PushedFilters: [EqualNullSafe(marketUnit,Daily_grocery)]
ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:struct<internalOrder:int,externalOrder:int>>,negligibleQuantitiesThreshold:struct<distributionCenter:struct<negligibleQuantitiesThresholdPercent:double>>,minOrderQtySettingInternal:int>

(2) ColumnarToRow [codegen id : 1]
Input [5]: [marketUnit#732142, minOrderQtySetting#732150, preferredUomSource#732159, negligibleQuantitiesThreshold#732161, minOrderQtySettingInternal#732163]

(3) Filter [codegen id : 1]
Input [5]: [marketUnit#732142, minOrderQtySetting#732150, preferredUomSource#732159, negligibleQuantitiesThreshold#732161, minOrderQtySettingInternal#732163]
Condition : (marketUnit#732142 <=> Daily_grocery)

(4) Project [codegen id : 1]
Output [5]: [minOrderQtySetting#732150, preferredUomSource#732159.distributionCenter.externalOrder AS _extract_externalOrder#732173, preferredUomSource#732159.distributionCenter.internalOrder AS _extract_internalOrder#732174, negligibleQuantitiesThreshold#732161.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]
Input [5]: [marketUnit#732142, minOrderQtySetting#732150, preferredUomSource#732159, negligibleQuantitiesThreshold#732161, minOrderQtySettingInternal#732163]

(5) Exchange
Input [5]: [minOrderQtySetting#732150, _extract_externalOrder#732173, _extract_internalOrder#732174, _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=291393]

(6) ShuffleQueryStage
Output [5]: [minOrderQtySetting#732150, _extract_externalOrder#732173, _extract_internalOrder#732174, _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]
Arguments: 0

(7) Project [codegen id : 2]
Output [5]: [minOrderQtySetting#732150, minOrderQtySettingInternal#732163, _extract_externalOrder#732173 AS externalOrder#732165, _extract_internalOrder#732174 AS internalOrder#732166, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#732175) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#732175 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#732175 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#732167]
Input [5]: [minOrderQtySetting#732150, _extract_externalOrder#732173, _extract_internalOrder#732174, _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]

(8) ResultQueryStage
Output [5]: [minOrderQtySetting#732150, minOrderQtySettingInternal#732163, externalOrder#732165, internalOrder#732166, negligibleQuantitiesThreshold#732167]
Arguments: 1

(9) Filter
Input [5]: [marketUnit#732142, minOrderQtySetting#732150, preferredUomSource#732159, negligibleQuantitiesThreshold#732161, minOrderQtySettingInternal#732163]
Condition : (marketUnit#732142 <=> Daily_grocery)

(10) Project
Output [5]: [minOrderQtySetting#732150, preferredUomSource#732159.distributionCenter.externalOrder AS _extract_externalOrder#732173, preferredUomSource#732159.distributionCenter.internalOrder AS _extract_internalOrder#732174, negligibleQuantitiesThreshold#732161.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]
Input [5]: [marketUnit#732142, minOrderQtySetting#732150, preferredUomSource#732159, negligibleQuantitiesThreshold#732161, minOrderQtySettingInternal#732163]

(11) Exchange
Input [5]: [minOrderQtySetting#732150, _extract_externalOrder#732173, _extract_internalOrder#732174, _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=291375]

(12) Project
Output [5]: [minOrderQtySetting#732150, minOrderQtySettingInternal#732163, _extract_externalOrder#732173 AS externalOrder#732165, _extract_internalOrder#732174 AS internalOrder#732166, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#732175) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#732175 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#732175 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#732167]
Input [5]: [minOrderQtySetting#732150, _extract_externalOrder#732173, _extract_internalOrder#732174, _extract_negligibleQuantitiesThresholdPercent#732175, minOrderQtySettingInternal#732163]

(13) AdaptiveSparkPlan
Output [5]: [minOrderQtySetting#732150, minOrderQtySettingInternal#732163, externalOrder#732165, internalOrder#732166, negligibleQuantitiesThreshold#732167]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
temporal.activity.id	eacc6933-3b5e-3a0b-bef3-b3c7a44b3467
temporal.activity.type	BufferDataSnapShot