crp-order-qty-opt-service - Details for Query 3524

Submitted Time: 2026/08/10 11:28:47
Duration: 2 s
Succeeded Jobs: 5373 5374

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" AdaptiveSparkPlan " tooltip="AdaptiveSparkPlan isFinalPlan=true"]; subgraph cluster1 { isCluster="true"; id="cluster1"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n10 ms (0 ms, 0 ms, 1 ms (stage 68246.0: task 170370))"; tooltip="WholeStageCodegen (2)"; 2 [id="node2" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#825829, minOrderQtySettingInternal#825842, _extract_externalOrder#825852 AS externalOrder#825844, _extract_internalOrder#825853 AS internalOrder#825845, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#825854) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#825854 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#825854 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#825846]"]; } 3 [id="node3" labelType="html" label="Exchange shuffle records written: 1 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 84.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 48.0 B local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 84.0 B" tooltip="Exchange RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=324980]"]; subgraph cluster4 { isCluster="true"; id="cluster4"; label="WholeStageCodegen (1)\n \nduration: 97 ms"; tooltip="WholeStageCodegen (1)"; 5 [id="node5" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#825829, preferredUomSource#825838.distributionCenter.externalOrder AS _extract_externalOrder#825852, preferredUomSource#825838.distributionCenter.internalOrder AS _extract_internalOrder#825853, negligibleQuantitiesThreshold#825840.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]"]; 6 [id="node6" labelType="html" label="Filter number of output rows: 1" tooltip="Filter (marketUnit#825821 <=> KA_REVIEW_CW31)"]; 7 [id="node7" labelType="html" label="ColumnarToRow number of output rows: 48 number of input batches: 1" tooltip="ColumnarToRow"]; } 8 [id="node8" labelType="html" label="Scan parquet number of files read: 1 scan time: 96 ms metadata time: 0 ms size of files read: 29.4 KiB number of output rows: 48" tooltip="FileScan parquet [marketUnit#825821,minOrderQtySetting#825829,preferredUomSource#825838,negligibleQuantitiesThreshold#825840,minOrderQtySettingInternal#825842] Batched: true, DataFilters: [(marketUnit#825821 <=> KA_REVIEW_CW31)], Format: Parquet, Location: PreparedDeltaFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20...., PartitionFilters: [], PushedFilters: [EqualNullSafe(marketUnit,KA_REVIEW_CW31)], ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:stru..."]; 2->0; 3->2; 5->3; 6->5; 7->6; 8->7; }

Details

== Physical Plan ==
AdaptiveSparkPlan (13)
+- == Final Plan ==
   ResultQueryStage (8), Statistics(sizeInBytes=8.0 EiB)
   +- * Project (7)
      +- ShuffleQueryStage (6), Statistics(sizeInBytes=48.0 B, rowCount=1)
         +- Exchange (5)
            +- * Project (4)
               +- * Filter (3)
                  +- * ColumnarToRow (2)
                     +- Scan parquet  (1)
+- == Initial Plan ==
   Project (12)
   +- Exchange (11)
      +- Project (10)
         +- Filter (9)
            +- Scan parquet  (1)


(1) Scan parquet 
Output [5]: [marketUnit#825821, minOrderQtySetting#825829, preferredUomSource#825838, negligibleQuantitiesThreshold#825840, minOrderQtySettingInternal#825842]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit]
PushedFilters: [EqualNullSafe(marketUnit,KA_REVIEW_CW31)]
ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:struct<internalOrder:int,externalOrder:int>>,negligibleQuantitiesThreshold:struct<distributionCenter:struct<negligibleQuantitiesThresholdPercent:double>>,minOrderQtySettingInternal:int>

(2) ColumnarToRow [codegen id : 1]
Input [5]: [marketUnit#825821, minOrderQtySetting#825829, preferredUomSource#825838, negligibleQuantitiesThreshold#825840, minOrderQtySettingInternal#825842]

(3) Filter [codegen id : 1]
Input [5]: [marketUnit#825821, minOrderQtySetting#825829, preferredUomSource#825838, negligibleQuantitiesThreshold#825840, minOrderQtySettingInternal#825842]
Condition : (marketUnit#825821 <=> KA_REVIEW_CW31)

(4) Project [codegen id : 1]
Output [5]: [minOrderQtySetting#825829, preferredUomSource#825838.distributionCenter.externalOrder AS _extract_externalOrder#825852, preferredUomSource#825838.distributionCenter.internalOrder AS _extract_internalOrder#825853, negligibleQuantitiesThreshold#825840.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]
Input [5]: [marketUnit#825821, minOrderQtySetting#825829, preferredUomSource#825838, negligibleQuantitiesThreshold#825840, minOrderQtySettingInternal#825842]

(5) Exchange
Input [5]: [minOrderQtySetting#825829, _extract_externalOrder#825852, _extract_internalOrder#825853, _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=324980]

(6) ShuffleQueryStage
Output [5]: [minOrderQtySetting#825829, _extract_externalOrder#825852, _extract_internalOrder#825853, _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]
Arguments: 0

(7) Project [codegen id : 2]
Output [5]: [minOrderQtySetting#825829, minOrderQtySettingInternal#825842, _extract_externalOrder#825852 AS externalOrder#825844, _extract_internalOrder#825853 AS internalOrder#825845, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#825854) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#825854 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#825854 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#825846]
Input [5]: [minOrderQtySetting#825829, _extract_externalOrder#825852, _extract_internalOrder#825853, _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]

(8) ResultQueryStage
Output [5]: [minOrderQtySetting#825829, minOrderQtySettingInternal#825842, externalOrder#825844, internalOrder#825845, negligibleQuantitiesThreshold#825846]
Arguments: 1

(9) Filter
Input [5]: [marketUnit#825821, minOrderQtySetting#825829, preferredUomSource#825838, negligibleQuantitiesThreshold#825840, minOrderQtySettingInternal#825842]
Condition : (marketUnit#825821 <=> KA_REVIEW_CW31)

(10) Project
Output [5]: [minOrderQtySetting#825829, preferredUomSource#825838.distributionCenter.externalOrder AS _extract_externalOrder#825852, preferredUomSource#825838.distributionCenter.internalOrder AS _extract_internalOrder#825853, negligibleQuantitiesThreshold#825840.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]
Input [5]: [marketUnit#825821, minOrderQtySetting#825829, preferredUomSource#825838, negligibleQuantitiesThreshold#825840, minOrderQtySettingInternal#825842]

(11) Exchange
Input [5]: [minOrderQtySetting#825829, _extract_externalOrder#825852, _extract_internalOrder#825853, _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=324962]

(12) Project
Output [5]: [minOrderQtySetting#825829, minOrderQtySettingInternal#825842, _extract_externalOrder#825852 AS externalOrder#825844, _extract_internalOrder#825853 AS internalOrder#825845, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#825854) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#825854 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#825854 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#825846]
Input [5]: [minOrderQtySetting#825829, _extract_externalOrder#825852, _extract_internalOrder#825853, _extract_negligibleQuantitiesThresholdPercent#825854, minOrderQtySettingInternal#825842]

(13) AdaptiveSparkPlan
Output [5]: [minOrderQtySetting#825829, minOrderQtySettingInternal#825842, externalOrder#825844, internalOrder#825845, negligibleQuantitiesThreshold#825846]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
temporal.activity.id	fb7b4da4-6e88-378d-8cf4-c7a1f0f29e12
temporal.activity.type	BufferDataSnapShot