== Physical Plan ==
AdaptiveSparkPlan (206)
+- == Final Plan ==
ResultQueryStage (203), Statistics(sizeInBytes=8.0 EiB)
+- * HashAggregate (202)
+- * HashAggregate (201)
+- TableCacheQueryStage (200), Statistics(sizeInBytes=65.3 KiB, rowCount=170)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=61.1 KiB, rowCount=170)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
HashAggregate (205)
+- HashAggregate (204)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=61.1 KiB, rowCount=170)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=70.4 KiB, rowCount=170)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=59.1 KiB, rowCount=170)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=65.1 KiB, rowCount=170)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=48.4 KiB, rowCount=40)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=13.1 KiB, rowCount=40)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1025.0 KiB, rowCount=25)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=3.2 KiB, rowCount=25)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=3.0 KiB, rowCount=25)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=2.5 KiB, rowCount=25)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=18.6 KiB, rowCount=170)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=47.1 KiB, rowCount=40)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=47.7 KiB, rowCount=40)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=40)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=9.7 KiB, rowCount=40)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=6.6 KiB, rowCount=40)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
(1) InMemoryTableScan
Output [2]: [sequenceId#996102, shardId#996555]
Arguments: [sequenceId#996102, shardId#996555]
(2) InMemoryRelation
Arguments: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, shardId#996555, worklistShardItemId#996556L, orderProposalItemGroupId#996557, ... 1 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [23]: [availabilityDateTime#996090, binId#996104, clusterId#996101L, deliveryDateTime#996084, isFallbackOrderOnly#996096, mrpController#996092, nextAvailabilityDateTime#996091, orderDateTime#996089, orderProposalHorizonGroupingId#996098L, orderProposalId#996097L, plant#996083, previousOrderProposal#996100L, product#996088, productGroup#996087, purchasingGroup#996095, purchasingOrg#996094, sequenceId#996102, sourceOfSupplyUuid#996093, splitIndicator#996099L, subrange#996085, supplier#996082, supplierGroup#996081, supplyingPlant#996086]
Arguments: [availabilityDateTime#996090, binId#996104, clusterId#996101L, deliveryDateTime#996084, isFallbackOrderOnly#996096, mrpController#996092, nextAvailabilityDateTime#996091, orderDateTime#996089, orderProposalHorizonGroupingId#996098L, orderProposalId#996097L, plant#996083, previousOrderProposal#996100L, product#996088, productGroup#996087, purchasingGroup#996095, purchasingOrg#996094, sequenceId#996102, sourceOfSupplyUuid#996093, splitIndicator#996099L, subrange#996085, supplier#996082, supplierGroup#996081, supplyingPlant#996086]
(4) InMemoryRelation
Arguments: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, avgItemsPerSequence#996103, binId#996104], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
(6) InMemoryRelation
Arguments: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971], StorageLevel(disk, memory, 2 replicas)
(7) InMemoryTableScan
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
(8) InMemoryRelation
Arguments: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971], StorageLevel(disk, memory, 2 replicas)
(9) Scan parquet
Output [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002111]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(10) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
(11) Filter [codegen id : 1]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Condition : ((size(productOrderSchedule#993487, true) > 0) AND isnotnull(productOrderSchedule#993487))
(12) Exchange
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=386796]
(13) ShuffleQueryStage
Output [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Arguments: 0
(14) Project [codegen id : 6]
Output [9]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, CASE WHEN isnotnull(supplyingPlant#993485) THEN productGroup#993486 ELSE subrange#993484 END AS effectiveSubrange#993507]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
(15) Exchange
Input [9]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: hashpartitioning(coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483), 25), ENSURE_REQUIREMENTS, [plan_id=387380]
(16) ShuffleQueryStage
Output [9]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: 7
(17) AQEShuffleRead
Input [9]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: local
(18) Scan parquet
Output [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002111/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(19) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
(20) Exchange
Input [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=386812]
(21) ShuffleQueryStage
Output [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Arguments: 1
(22) Scan parquet
Output [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>,orderSplitCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,multiplesOrderQuantity:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(23) ColumnarToRow [codegen id : 3]
Input [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
(24) Filter [codegen id : 3]
Input [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Condition : isnotnull(orderGroupingProfile#993499)
(25) Exchange
Input [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=386825]
(26) ShuffleQueryStage
Output [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Arguments: 2
(27) BroadcastExchange
Input [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=386833]
(28) BroadcastQueryStage
Output [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Arguments: 6
(29) BroadcastHashJoin [codegen id : 7]
Left keys [1]: [orderGroupingProfile#993492]
Right keys [1]: [orderGroupingProfile#993499]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, subrange#993489 AS effectiveSubrange#993508]
Input [10]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
(31) Exchange
Input [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
Arguments: hashpartitioning(coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491), 25), ENSURE_REQUIREMENTS, [plan_id=387470]
(32) ShuffleQueryStage
Output [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
Arguments: 8
(33) AQEShuffleRead
Input [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
Arguments: local
(34) BroadcastExchange
Input [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[8, string, true], ), isnull(input[8, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=387605]
(35) BroadcastQueryStage
Output [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
Arguments: 9
(36) BroadcastHashJoin [codegen id : 8]
Left keys [10]: [coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483)]
Right keys [10]: [coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491)]
Join type: LeftOuter
Join condition: None
(37) Project [codegen id : 8]
Output [14]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, CASE WHEN isnull(orderGroupCriteria#993501) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#993501 END AS orderGroupCriteria#993520, CASE WHEN isnull(orderSplitCriteria#993502) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#993502 END AS orderSplitCriteria#993530, orderGroupingProfile#993492, coalesce(supplierGroup#993480, supplier#993481) AS supplierOrGroup#993509, coalesce(locationGroup#993494, plant#993482) AS locationOrGroup#993510]
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
(38) Project [codegen id : 8]
Output [26]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520.supplierSubrange AS _extract_supplierSubrange#994114, orderGroupCriteria#993520.mrpController AS _extract_mrpController#994115, orderGroupCriteria#993520.purchasingOrg AS _extract_purchasingOrg#994116, orderGroupCriteria#993520.orderDate AS _extract_orderDate#994117, orderGroupCriteria#993520.deliveryDate AS _extract_deliveryDate#994118, orderGroupCriteria#993520.supplier AS _extract_supplier#994119, orderGroupCriteria#993520.purchasingGroup AS _extract_purchasingGroup#994120, orderSplitCriteria#993530.supplierSubrange AS _extract_supplierSubrange#994121, orderSplitCriteria#993530.mrpController AS _extract_mrpController#994122, orderSplitCriteria#993530.orderDate AS _extract_orderDate#994123, orderSplitCriteria#993530.supplier AS _extract_supplier#994124, orderSplitCriteria#993530.deliveryDate AS _extract_deliveryDate#994125, orderSplitCriteria#993530.purchasingOrg AS _extract_purchasingOrg#994126, orderSplitCriteria#993530.purchasingGroup AS _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Input [14]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520, orderSplitCriteria#993530, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
(39) Generate [codegen id : 8]
Input [26]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, _extract_supplierSubrange#994114, _extract_mrpController#994115, _extract_purchasingOrg#994116, _extract_orderDate#994117, _extract_deliveryDate#994118, _extract_supplier#994119, _extract_purchasingGroup#994120, _extract_supplierSubrange#994121, _extract_mrpController#994122, _extract_orderDate#994123, _extract_supplier#994124, _extract_deliveryDate#994125, _extract_purchasingOrg#994126, _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Arguments: explode(productOrderSchedule#993487), [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, effectiveSubrange#993507, _extract_supplierSubrange#994114, _extract_mrpController#994115, _extract_purchasingOrg#994116, _extract_orderDate#994117, _extract_deliveryDate#994118, _extract_supplier#994119, _extract_purchasingGroup#994120, _extract_supplierSubrange#994121, _extract_mrpController#994122, _extract_orderDate#994123, _extract_supplier#994124, _extract_deliveryDate#994125, _extract_purchasingOrg#994126, _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510], false, [productOrderScheduleExploded#993532]
(40) Project [codegen id : 8]
Output [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderScheduleExploded#993532.product AS product#993533, productOrderScheduleExploded#993532.orderDateTime AS orderDateTime#993534, productOrderScheduleExploded#993532.availabilityDateTime AS availabilityDateTime#993535, productOrderScheduleExploded#993532.nextAvailabilityDateTime AS nextAvailabilityDateTime#993536, productOrderScheduleExploded#993532.mrpController AS mrpController#993537, productOrderScheduleExploded#993532.sourceOfSupplyUuid AS sourceOfSupplyUuid#993538, productOrderScheduleExploded#993532.purchasingOrg AS purchasingOrg#993539, productOrderScheduleExploded#993532.purchasingGroup AS purchasingGroup#993540, productOrderScheduleExploded#993532.isFallbackOrderOnly AS isFallbackOrderOnly#993541, xxhash64(CASE WHEN (_extract_supplierSubrange#994114 <=> true) THEN effectiveSubrange#993507 END, orderGroupingProfile#993492, CASE WHEN (_extract_mrpController#994115 <=> true) THEN productOrderScheduleExploded#993532.mrpController END, CASE WHEN (_extract_purchasingOrg#994116 <=> true) THEN productOrderScheduleExploded#993532.purchasingOrg END, CASE WHEN (_extract_orderDate#994117 <=> true) THEN productOrderScheduleExploded#993532.orderDateTime END, CASE WHEN (_extract_deliveryDate#994118 <=> true) THEN deliveryDateTime#993483 END, CASE WHEN (_extract_supplier#994119 <=> true) THEN supplierOrGroup#993509 END, locationOrGroup#993510, CASE WHEN (_extract_purchasingGroup#994120 <=> true) THEN productOrderScheduleExploded#993532.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#993507) AND (_extract_supplierSubrange#994114 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#993492) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.mrpController) AND (_extract_mrpController#994115 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingOrg) AND (_extract_purchasingOrg#994116 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.orderDateTime) AND (_extract_orderDate#994117 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#993483) AND (_extract_deliveryDate#994118 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#993509) AND (_extract_supplier#994119 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#993510) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingGroup) AND (_extract_purchasingGroup#994120 <=> true)) THEN 256 ELSE 0 END), 10000002111, 42) AS orderProposalId#993568L, xxhash64(CASE WHEN (_extract_supplierSubrange#994121 <=> true) THEN effectiveSubrange#993507 END, orderGroupingProfile#993492, CASE WHEN (_extract_mrpController#994122 <=> true) THEN productOrderScheduleExploded#993532.mrpController END, CASE WHEN (_extract_orderDate#994123 <=> true) THEN productOrderScheduleExploded#993532.orderDateTime END, CASE WHEN (_extract_supplier#994124 <=> true) THEN supplier#993481 END, CASE WHEN (_extract_deliveryDate#994125 <=> true) THEN deliveryDateTime#993483 END, CASE WHEN (_extract_purchasingOrg#994126 <=> true) THEN productOrderScheduleExploded#993532.purchasingOrg END, plant#993482, CASE WHEN (_extract_purchasingGroup#994127 <=> true) THEN productOrderScheduleExploded#993532.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#993507) AND (_extract_supplierSubrange#994121 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#993492) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.mrpController) AND (_extract_mrpController#994122 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.orderDateTime) AND (_extract_orderDate#994123 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#993481) AND (_extract_supplier#994124 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#993483) AND (_extract_deliveryDate#994125 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingOrg) AND (_extract_purchasingOrg#994126 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#993482) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingGroup) AND (_extract_purchasingGroup#994127 <=> true)) THEN 256 ELSE 0 END), 10000002111, 42) AS splitIndicator#993596L]
Input [26]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, effectiveSubrange#993507, _extract_supplierSubrange#994114, _extract_mrpController#994115, _extract_purchasingOrg#994116, _extract_orderDate#994117, _extract_deliveryDate#994118, _extract_supplier#994119, _extract_purchasingGroup#994120, _extract_supplierSubrange#994121, _extract_mrpController#994122, _extract_orderDate#994123, _extract_supplier#994124, _extract_deliveryDate#994125, _extract_purchasingOrg#994126, _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510, productOrderScheduleExploded#993532]
(41) Exchange
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L]
Arguments: hashpartitioning(product#993533, plant#993482, 25), ENSURE_REQUIREMENTS, [plan_id=387686]
(42) ShuffleQueryStage
Output [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L]
Arguments: 10
(43) Sort [codegen id : 9]
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L]
Arguments: [product#993533 ASC NULLS FIRST, plant#993482 ASC NULLS FIRST, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST], false, 0
(44) Window
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L]
Arguments: [lag(orderProposalId#993568L, -1, null) windowspecdefinition(product#993533, plant#993482, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#993597L], [product#993533, plant#993482], [availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST]
(45) InMemoryTableScan
Output [4]: [clusterId#993655L, orderProposalId#993650L, plant#993651, previousOrderProposals#993652]
Arguments: [clusterId#993655L, orderProposalId#993650L, plant#993651, previousOrderProposals#993652]
(46) InMemoryRelation
Arguments: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, nodeId#993653L, dependentOnNodeIds#993654, clusterId#993655L, unresolvedDependencies#993656], StorageLevel(disk, memory, 2 replicas)
(47) Scan parquet
Output [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002111]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(48) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
(49) Filter [codegen id : 1]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Condition : ((size(productOrderSchedule#993487, true) > 0) AND isnotnull(productOrderSchedule#993487))
(50) Exchange
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=385508]
(51) ShuffleQueryStage
Output [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Arguments: 0
(52) Project [codegen id : 4]
Output [6]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, CASE WHEN isnotnull(supplyingPlant#993485) THEN productGroup#993486 ELSE subrange#993484 END AS effectiveSubrange#993507]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
(53) Exchange
Input [6]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: hashpartitioning(coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483), 25), ENSURE_REQUIREMENTS, [plan_id=385779]
(54) ShuffleQueryStage
Output [6]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: 3
(55) AQEShuffleRead
Input [6]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: local
(56) Scan parquet
Output [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002111/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(57) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
(58) Exchange
Input [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=385524]
(59) ShuffleQueryStage
Output [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Arguments: 1
(60) Scan parquet
Output [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(61) ColumnarToRow [codegen id : 3]
Input [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
(62) Filter [codegen id : 3]
Input [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Condition : isnotnull(orderGroupingProfile#993499)
(63) Exchange
Input [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=385537]
(64) ShuffleQueryStage
Output [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Arguments: 2
(65) BroadcastExchange
Input [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=385545]
(66) BroadcastQueryStage
Output [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Arguments: 4
(67) BroadcastHashJoin [codegen id : 5]
Left keys [1]: [orderGroupingProfile#993492]
Right keys [1]: [orderGroupingProfile#993499]
Join type: LeftOuter
Join condition: None
(68) Project [codegen id : 5]
Output [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, subrange#993489 AS effectiveSubrange#993508]
Input [9]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupingProfile#993499, orderGroupCriteria#993501]
(69) Exchange
Input [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
Arguments: hashpartitioning(coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491), 25), ENSURE_REQUIREMENTS, [plan_id=386052]
(70) ShuffleQueryStage
Output [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
Arguments: 5
(71) AQEShuffleRead
Input [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
Arguments: local
(72) BroadcastExchange
Input [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[7, string, true], ), isnull(input[7, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=386272]
(73) BroadcastQueryStage
Output [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
Arguments: 6
(74) BroadcastHashJoin [codegen id : 6]
Left keys [10]: [coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483)]
Right keys [10]: [coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491)]
Join type: LeftOuter
Join condition: None
(75) Project [codegen id : 6]
Output [8]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, CASE WHEN isnull(orderGroupCriteria#993501) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#993501 END AS orderGroupCriteria#993520, orderGroupingProfile#993492, coalesce(supplierGroup#993480, supplier#993481) AS supplierOrGroup#993509, coalesce(locationGroup#993494, plant#993482) AS locationOrGroup#993510]
Input [14]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
(76) Project [codegen id : 6]
Output [14]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520.supplierSubrange AS _extract_supplierSubrange#993657, orderGroupCriteria#993520.mrpController AS _extract_mrpController#993658, orderGroupCriteria#993520.purchasingOrg AS _extract_purchasingOrg#993659, orderGroupCriteria#993520.orderDate AS _extract_orderDate#993660, orderGroupCriteria#993520.deliveryDate AS _extract_deliveryDate#993661, orderGroupCriteria#993520.supplier AS _extract_supplier#993662, orderGroupCriteria#993520.purchasingGroup AS _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Input [8]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
(77) Generate [codegen id : 6]
Input [14]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, _extract_supplierSubrange#993657, _extract_mrpController#993658, _extract_purchasingOrg#993659, _extract_orderDate#993660, _extract_deliveryDate#993661, _extract_supplier#993662, _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Arguments: explode(productOrderSchedule#993487), [plant#993482, deliveryDateTime#993483, effectiveSubrange#993507, _extract_supplierSubrange#993657, _extract_mrpController#993658, _extract_purchasingOrg#993659, _extract_orderDate#993660, _extract_deliveryDate#993661, _extract_supplier#993662, _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510], false, [productOrderScheduleExploded#993532]
(78) Project [codegen id : 6]
Output [5]: [plant#993482, productOrderScheduleExploded#993532.product AS product#993533, productOrderScheduleExploded#993532.orderDateTime AS orderDateTime#993534, productOrderScheduleExploded#993532.availabilityDateTime AS availabilityDateTime#993535, xxhash64(CASE WHEN (_extract_supplierSubrange#993657 <=> true) THEN effectiveSubrange#993507 END, orderGroupingProfile#993492, CASE WHEN (_extract_mrpController#993658 <=> true) THEN productOrderScheduleExploded#993532.mrpController END, CASE WHEN (_extract_purchasingOrg#993659 <=> true) THEN productOrderScheduleExploded#993532.purchasingOrg END, CASE WHEN (_extract_orderDate#993660 <=> true) THEN productOrderScheduleExploded#993532.orderDateTime END, CASE WHEN (_extract_deliveryDate#993661 <=> true) THEN deliveryDateTime#993483 END, CASE WHEN (_extract_supplier#993662 <=> true) THEN supplierOrGroup#993509 END, locationOrGroup#993510, CASE WHEN (_extract_purchasingGroup#993663 <=> true) THEN productOrderScheduleExploded#993532.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#993507) AND (_extract_supplierSubrange#993657 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#993492) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.mrpController) AND (_extract_mrpController#993658 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingOrg) AND (_extract_purchasingOrg#993659 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.orderDateTime) AND (_extract_orderDate#993660 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#993483) AND (_extract_deliveryDate#993661 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#993509) AND (_extract_supplier#993662 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#993510) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingGroup) AND (_extract_purchasingGroup#993663 <=> true)) THEN 256 ELSE 0 END), 10000002111, 42) AS orderProposalId#993568L]
Input [14]: [plant#993482, deliveryDateTime#993483, effectiveSubrange#993507, _extract_supplierSubrange#993657, _extract_mrpController#993658, _extract_purchasingOrg#993659, _extract_orderDate#993660, _extract_deliveryDate#993661, _extract_supplier#993662, _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510, productOrderScheduleExploded#993532]
(79) Exchange
Input [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: hashpartitioning(product#993533, plant#993482, 25), ENSURE_REQUIREMENTS, [plan_id=386399]
(80) ShuffleQueryStage
Output [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: 7
(81) AQEShuffleRead
Input [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: coalesced
(82) Sort [codegen id : 7]
Input [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: [product#993533 ASC NULLS FIRST, plant#993482 ASC NULLS FIRST, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST], false, 0
(83) Window
Input [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: [lag(orderProposalId#993568L, -1, null) windowspecdefinition(product#993533, plant#993482, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#993597L], [product#993533, plant#993482], [availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST]
(84) Project [codegen id : 8]
Output [3]: [plant#993482, orderProposalId#993568L, previousOrderProposal#993597L]
Input [6]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L, previousOrderProposal#993597L]
(85) ObjectHashAggregate
Input [3]: [plant#993482, orderProposalId#993568L, previousOrderProposal#993597L]
Keys [1]: [orderProposalId#993568L]
Functions [2]: [partial_min(plant#993482), partial_collect_set(previousOrderProposal#993597L, 0, 0)]
Aggregate Attributes [2]: [min#993730, buf#993731]
Results [3]: [orderProposalId#993568L, min#993732, buf#993733]
(86) Exchange
Input [3]: [orderProposalId#993568L, min#993732, buf#993733]
Arguments: hashpartitioning(orderProposalId#993568L, 25), ENSURE_REQUIREMENTS, [plan_id=386497]
(87) ShuffleQueryStage
Output [3]: [orderProposalId#993568L, min#993732, buf#993733]
Arguments: 8
(88) AQEShuffleRead
Input [3]: [orderProposalId#993568L, min#993732, buf#993733]
Arguments: coalesced
(89) ObjectHashAggregate
Input [3]: [orderProposalId#993568L, min#993732, buf#993733]
Keys [1]: [orderProposalId#993568L]
Functions [2]: [min(plant#993482), collect_set(previousOrderProposal#993597L, 0, 0)]
Aggregate Attributes [2]: [min(plant#993482)#993620, collect_set(previousOrderProposal#993597L, 0, 0)#993621]
Results [4]: [orderProposalId#993568L, min(plant#993482)#993620 AS plant#993598, collect_set(previousOrderProposal#993597L, 0, 0)#993621 AS previousOrderProposals#993599, orderProposalId#993568L AS nodeId#993622L]
(90) Project [codegen id : 9]
Output [5]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L, previousOrderProposals#993599 AS dependentOnNodeIds#993623]
Input [4]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L]
(91) Exchange
Input [5]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L, dependentOnNodeIds#993623]
Arguments: hashpartitioning(plant#993598, 25), REPARTITION_BY_COL, [plan_id=386549]
(92) ShuffleQueryStage
Output [5]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L, dependentOnNodeIds#993623]
Arguments: 9
(93) DeserializeToObject
Input [5]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L, dependentOnNodeIds#993623]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#993568L)), invoke(plant#993598.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#993599, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#993622L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#993623, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#993634: org.apache.spark.sql.Row
(94) MapPartitions
Input [1]: [obj#993634]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@5445319e, obj#993642: org.apache.spark.sql.Row
(95) SerializeFromObject [codegen id : 10]
Input [1]: [obj#993642]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#993650L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#993651, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#993652, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#993653L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#993654, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#993655L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#993656]
(96) ResultQueryStage
Output [7]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, nodeId#993653L, dependentOnNodeIds#993654, clusterId#993655L, unresolvedDependencies#993656]
Arguments: 10
(97) Filter
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Condition : ((size(productOrderSchedule#993487, true) > 0) AND isnotnull(productOrderSchedule#993487))
(98) Exchange
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=385386]
(99) Project
Output [6]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, CASE WHEN isnotnull(supplyingPlant#993485) THEN productGroup#993486 ELSE subrange#993484 END AS effectiveSubrange#993507]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
(100) Exchange
Input [6]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: hashpartitioning(coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483), 25), ENSURE_REQUIREMENTS, [plan_id=385410]
(101) Sort
Input [6]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: [coalesce(supplierGroup#993480, ) ASC NULLS FIRST, isnull(supplierGroup#993480) ASC NULLS FIRST, coalesce(supplier#993481, ) ASC NULLS FIRST, isnull(supplier#993481) ASC NULLS FIRST, coalesce(effectiveSubrange#993507, ) ASC NULLS FIRST, isnull(effectiveSubrange#993507) ASC NULLS FIRST, coalesce(plant#993482, ) ASC NULLS FIRST, isnull(plant#993482) ASC NULLS FIRST, coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#993483) ASC NULLS FIRST], false, 0
(102) Exchange
Input [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=385364]
(103) Filter
Input [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Condition : isnotnull(orderGroupingProfile#993499)
(104) Exchange
Input [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=385388]
(105) BroadcastExchange
Input [2]: [orderGroupingProfile#993499, orderGroupCriteria#993501]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=385405]
(106) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#993492]
Right keys [1]: [orderGroupingProfile#993499]
Join type: LeftOuter
Join condition: None
(107) Project
Output [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, subrange#993489 AS effectiveSubrange#993508]
Input [9]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupingProfile#993499, orderGroupCriteria#993501]
(108) Exchange
Input [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
Arguments: hashpartitioning(coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491), 25), ENSURE_REQUIREMENTS, [plan_id=385411]
(109) Sort
Input [8]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
Arguments: [coalesce(supplierGroup#993493, ) ASC NULLS FIRST, isnull(supplierGroup#993493) ASC NULLS FIRST, coalesce(supplier#993488, ) ASC NULLS FIRST, isnull(supplier#993488) ASC NULLS FIRST, coalesce(effectiveSubrange#993508, ) ASC NULLS FIRST, isnull(effectiveSubrange#993508) ASC NULLS FIRST, coalesce(plant#993490, ) ASC NULLS FIRST, isnull(plant#993490) ASC NULLS FIRST, coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#993491) ASC NULLS FIRST], false, 0
(110) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483)]
Right keys [10]: [coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491)]
Join type: LeftOuter
Join condition: None
(111) Project
Output [8]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, CASE WHEN isnull(orderGroupCriteria#993501) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#993501 END AS orderGroupCriteria#993520, orderGroupingProfile#993492, coalesce(supplierGroup#993480, supplier#993481) AS supplierOrGroup#993509, coalesce(locationGroup#993494, plant#993482) AS locationOrGroup#993510]
Input [14]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, effectiveSubrange#993508]
(112) Project
Output [14]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520.supplierSubrange AS _extract_supplierSubrange#993657, orderGroupCriteria#993520.mrpController AS _extract_mrpController#993658, orderGroupCriteria#993520.purchasingOrg AS _extract_purchasingOrg#993659, orderGroupCriteria#993520.orderDate AS _extract_orderDate#993660, orderGroupCriteria#993520.deliveryDate AS _extract_deliveryDate#993661, orderGroupCriteria#993520.supplier AS _extract_supplier#993662, orderGroupCriteria#993520.purchasingGroup AS _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Input [8]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
(113) Generate
Input [14]: [plant#993482, deliveryDateTime#993483, productOrderSchedule#993487, effectiveSubrange#993507, _extract_supplierSubrange#993657, _extract_mrpController#993658, _extract_purchasingOrg#993659, _extract_orderDate#993660, _extract_deliveryDate#993661, _extract_supplier#993662, _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Arguments: explode(productOrderSchedule#993487), [plant#993482, deliveryDateTime#993483, effectiveSubrange#993507, _extract_supplierSubrange#993657, _extract_mrpController#993658, _extract_purchasingOrg#993659, _extract_orderDate#993660, _extract_deliveryDate#993661, _extract_supplier#993662, _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510], false, [productOrderScheduleExploded#993532]
(114) Project
Output [5]: [plant#993482, productOrderScheduleExploded#993532.product AS product#993533, productOrderScheduleExploded#993532.orderDateTime AS orderDateTime#993534, productOrderScheduleExploded#993532.availabilityDateTime AS availabilityDateTime#993535, xxhash64(CASE WHEN (_extract_supplierSubrange#993657 <=> true) THEN effectiveSubrange#993507 END, orderGroupingProfile#993492, CASE WHEN (_extract_mrpController#993658 <=> true) THEN productOrderScheduleExploded#993532.mrpController END, CASE WHEN (_extract_purchasingOrg#993659 <=> true) THEN productOrderScheduleExploded#993532.purchasingOrg END, CASE WHEN (_extract_orderDate#993660 <=> true) THEN productOrderScheduleExploded#993532.orderDateTime END, CASE WHEN (_extract_deliveryDate#993661 <=> true) THEN deliveryDateTime#993483 END, CASE WHEN (_extract_supplier#993662 <=> true) THEN supplierOrGroup#993509 END, locationOrGroup#993510, CASE WHEN (_extract_purchasingGroup#993663 <=> true) THEN productOrderScheduleExploded#993532.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#993507) AND (_extract_supplierSubrange#993657 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#993492) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.mrpController) AND (_extract_mrpController#993658 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingOrg) AND (_extract_purchasingOrg#993659 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.orderDateTime) AND (_extract_orderDate#993660 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#993483) AND (_extract_deliveryDate#993661 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#993509) AND (_extract_supplier#993662 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#993510) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingGroup) AND (_extract_purchasingGroup#993663 <=> true)) THEN 256 ELSE 0 END), 10000002111, 42) AS orderProposalId#993568L]
Input [14]: [plant#993482, deliveryDateTime#993483, effectiveSubrange#993507, _extract_supplierSubrange#993657, _extract_mrpController#993658, _extract_purchasingOrg#993659, _extract_orderDate#993660, _extract_deliveryDate#993661, _extract_supplier#993662, _extract_purchasingGroup#993663, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510, productOrderScheduleExploded#993532]
(115) Exchange
Input [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: hashpartitioning(product#993533, plant#993482, 25), ENSURE_REQUIREMENTS, [plan_id=385420]
(116) Sort
Input [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: [product#993533 ASC NULLS FIRST, plant#993482 ASC NULLS FIRST, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST], false, 0
(117) Window
Input [5]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L]
Arguments: [lag(orderProposalId#993568L, -1, null) windowspecdefinition(product#993533, plant#993482, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#993597L], [product#993533, plant#993482], [availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST]
(118) Project
Output [3]: [plant#993482, orderProposalId#993568L, previousOrderProposal#993597L]
Input [6]: [plant#993482, product#993533, orderDateTime#993534, availabilityDateTime#993535, orderProposalId#993568L, previousOrderProposal#993597L]
(119) ObjectHashAggregate
Input [3]: [plant#993482, orderProposalId#993568L, previousOrderProposal#993597L]
Keys [1]: [orderProposalId#993568L]
Functions [2]: [partial_min(plant#993482), partial_collect_set(previousOrderProposal#993597L, 0, 0)]
Aggregate Attributes [2]: [min#993730, buf#993731]
Results [3]: [orderProposalId#993568L, min#993732, buf#993733]
(120) Exchange
Input [3]: [orderProposalId#993568L, min#993732, buf#993733]
Arguments: hashpartitioning(orderProposalId#993568L, 25), ENSURE_REQUIREMENTS, [plan_id=385426]
(121) ObjectHashAggregate
Input [3]: [orderProposalId#993568L, min#993732, buf#993733]
Keys [1]: [orderProposalId#993568L]
Functions [2]: [min(plant#993482), collect_set(previousOrderProposal#993597L, 0, 0)]
Aggregate Attributes [2]: [min(plant#993482)#993620, collect_set(previousOrderProposal#993597L, 0, 0)#993621]
Results [4]: [orderProposalId#993568L, min(plant#993482)#993620 AS plant#993598, collect_set(previousOrderProposal#993597L, 0, 0)#993621 AS previousOrderProposals#993599, orderProposalId#993568L AS nodeId#993622L]
(122) Project
Output [5]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L, previousOrderProposals#993599 AS dependentOnNodeIds#993623]
Input [4]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L]
(123) Exchange
Input [5]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L, dependentOnNodeIds#993623]
Arguments: hashpartitioning(plant#993598, 25), REPARTITION_BY_COL, [plan_id=385429]
(124) DeserializeToObject
Input [5]: [orderProposalId#993568L, plant#993598, previousOrderProposals#993599, nodeId#993622L, dependentOnNodeIds#993623]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#993568L)), invoke(plant#993598.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#993599, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#993622L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#993623, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#993634: org.apache.spark.sql.Row
(125) MapPartitions
Input [1]: [obj#993634]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@5445319e, obj#993642: org.apache.spark.sql.Row
(126) SerializeFromObject
Input [1]: [obj#993642]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#993650L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#993651, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#993652, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#993653L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#993654, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#993655L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#993656]
(127) AdaptiveSparkPlan
Output [7]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, nodeId#993653L, dependentOnNodeIds#993654, clusterId#993655L, unresolvedDependencies#993656]
Arguments: isFinalPlan=true
(128) TableCacheQueryStage
Output [4]: [clusterId#993655L, orderProposalId#993650L, plant#993651, previousOrderProposals#993652]
Arguments: 3
(129) Project [codegen id : 4]
Output [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, orderProposalId#993650L AS nodeId#993935L, previousOrderProposals#993652 AS dependentOnNodeIds#993936]
Input [4]: [clusterId#993655L, orderProposalId#993650L, plant#993651, previousOrderProposals#993652]
(130) Exchange
Input [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, nodeId#993935L, dependentOnNodeIds#993936]
Arguments: hashpartitioning(clusterId#993655L, 25), REPARTITION_BY_COL, [plan_id=386982]
(131) ShuffleQueryStage
Output [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, nodeId#993935L, dependentOnNodeIds#993936]
Arguments: 4
(132) AQEShuffleRead
Input [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, nodeId#993935L, dependentOnNodeIds#993936]
Arguments: coalesced
(133) DeserializeToObject
Input [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, nodeId#993935L, dependentOnNodeIds#993936]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#993650L)), invoke(plant#993651.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#993652, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#993655L)), static_invoke(java.lang.Long.valueOf(nodeId#993935L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#993936, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#993949: org.apache.spark.sql.Row
(134) MapPartitions
Input [1]: [obj#993949]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@c7b81b4, obj#993957: org.apache.spark.sql.Row
(135) SerializeFromObject [codegen id : 5]
Input [1]: [obj#993957]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#993965L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#993968L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#993971]
(136) BroadcastExchange
Input [3]: [orderProposalId#993965L, clusterId#993968L, sequenceId#993971]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=387152]
(137) BroadcastQueryStage
Output [3]: [orderProposalId#993965L, clusterId#993968L, sequenceId#993971]
Arguments: 5
(138) BroadcastHashJoin [codegen id : 10]
Left keys [1]: [orderProposalId#993568L]
Right keys [1]: [orderProposalId#993965L]
Join type: LeftOuter
Join condition: None
(139) Project [codegen id : 10]
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, 0 AS orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L, previousOrderProposal#993597L, orderProposalId#993965L, clusterId#993968L, sequenceId#993971]
(140) ResultQueryStage
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: 11
(141) Filter
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Condition : ((size(productOrderSchedule#993487, true) > 0) AND isnotnull(productOrderSchedule#993487))
(142) Exchange
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=386696]
(143) Project
Output [9]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, CASE WHEN isnotnull(supplyingPlant#993485) THEN productGroup#993486 ELSE subrange#993484 END AS effectiveSubrange#993507]
Input [8]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487]
(144) Exchange
Input [9]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: hashpartitioning(coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483), 25), ENSURE_REQUIREMENTS, [plan_id=386714]
(145) Sort
Input [9]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507]
Arguments: [coalesce(supplierGroup#993480, ) ASC NULLS FIRST, isnull(supplierGroup#993480) ASC NULLS FIRST, coalesce(supplier#993481, ) ASC NULLS FIRST, isnull(supplier#993481) ASC NULLS FIRST, coalesce(effectiveSubrange#993507, ) ASC NULLS FIRST, isnull(effectiveSubrange#993507) ASC NULLS FIRST, coalesce(plant#993482, ) ASC NULLS FIRST, isnull(plant#993482) ASC NULLS FIRST, coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#993483) ASC NULLS FIRST], false, 0
(146) Exchange
Input [7]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=386674]
(147) Filter
Input [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Condition : isnotnull(orderGroupingProfile#993499)
(148) Exchange
Input [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=386698]
(149) BroadcastExchange
Input [3]: [orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=386709]
(150) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#993492]
Right keys [1]: [orderGroupingProfile#993499]
Join type: LeftOuter
Join condition: None
(151) Project
Output [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, subrange#993489 AS effectiveSubrange#993508]
Input [10]: [supplier#993488, subrange#993489, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupingProfile#993499, orderGroupCriteria#993501, orderSplitCriteria#993502]
(152) Exchange
Input [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
Arguments: hashpartitioning(coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491), 25), ENSURE_REQUIREMENTS, [plan_id=386715]
(153) Sort
Input [9]: [supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
Arguments: [coalesce(supplierGroup#993493, ) ASC NULLS FIRST, isnull(supplierGroup#993493) ASC NULLS FIRST, coalesce(supplier#993488, ) ASC NULLS FIRST, isnull(supplier#993488) ASC NULLS FIRST, coalesce(effectiveSubrange#993508, ) ASC NULLS FIRST, isnull(effectiveSubrange#993508) ASC NULLS FIRST, coalesce(plant#993490, ) ASC NULLS FIRST, isnull(plant#993490) ASC NULLS FIRST, coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#993491) ASC NULLS FIRST], false, 0
(154) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#993480, ), isnull(supplierGroup#993480), coalesce(supplier#993481, ), isnull(supplier#993481), coalesce(effectiveSubrange#993507, ), isnull(effectiveSubrange#993507), coalesce(plant#993482, ), isnull(plant#993482), coalesce(deliveryDateTime#993483, 1970-01-01 00:00:00), isnull(deliveryDateTime#993483)]
Right keys [10]: [coalesce(supplierGroup#993493, ), isnull(supplierGroup#993493), coalesce(supplier#993488, ), isnull(supplier#993488), coalesce(effectiveSubrange#993508, ), isnull(effectiveSubrange#993508), coalesce(plant#993490, ), isnull(plant#993490), coalesce(deliveryDateTime#993491, 1970-01-01 00:00:00), isnull(deliveryDateTime#993491)]
Join type: LeftOuter
Join condition: None
(155) Project
Output [14]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, CASE WHEN isnull(orderGroupCriteria#993501) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#993501 END AS orderGroupCriteria#993520, CASE WHEN isnull(orderSplitCriteria#993502) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#993502 END AS orderSplitCriteria#993530, orderGroupingProfile#993492, coalesce(supplierGroup#993480, supplier#993481) AS supplierOrGroup#993509, coalesce(locationGroup#993494, plant#993482) AS locationOrGroup#993510]
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, supplier#993488, plant#993490, deliverydatetime#993491, ordergroupingprofile#993492, supplierGroup#993493, locationGroup#993494, orderGroupCriteria#993501, orderSplitCriteria#993502, effectiveSubrange#993508]
(156) Project
Output [26]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520.supplierSubrange AS _extract_supplierSubrange#994114, orderGroupCriteria#993520.mrpController AS _extract_mrpController#994115, orderGroupCriteria#993520.purchasingOrg AS _extract_purchasingOrg#994116, orderGroupCriteria#993520.orderDate AS _extract_orderDate#994117, orderGroupCriteria#993520.deliveryDate AS _extract_deliveryDate#994118, orderGroupCriteria#993520.supplier AS _extract_supplier#994119, orderGroupCriteria#993520.purchasingGroup AS _extract_purchasingGroup#994120, orderSplitCriteria#993530.supplierSubrange AS _extract_supplierSubrange#994121, orderSplitCriteria#993530.mrpController AS _extract_mrpController#994122, orderSplitCriteria#993530.orderDate AS _extract_orderDate#994123, orderSplitCriteria#993530.supplier AS _extract_supplier#994124, orderSplitCriteria#993530.deliveryDate AS _extract_deliveryDate#994125, orderSplitCriteria#993530.purchasingOrg AS _extract_purchasingOrg#994126, orderSplitCriteria#993530.purchasingGroup AS _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Input [14]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, orderGroupCriteria#993520, orderSplitCriteria#993530, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
(157) Generate
Input [26]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderSchedule#993487, effectiveSubrange#993507, _extract_supplierSubrange#994114, _extract_mrpController#994115, _extract_purchasingOrg#994116, _extract_orderDate#994117, _extract_deliveryDate#994118, _extract_supplier#994119, _extract_purchasingGroup#994120, _extract_supplierSubrange#994121, _extract_mrpController#994122, _extract_orderDate#994123, _extract_supplier#994124, _extract_deliveryDate#994125, _extract_purchasingOrg#994126, _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510]
Arguments: explode(productOrderSchedule#993487), [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, effectiveSubrange#993507, _extract_supplierSubrange#994114, _extract_mrpController#994115, _extract_purchasingOrg#994116, _extract_orderDate#994117, _extract_deliveryDate#994118, _extract_supplier#994119, _extract_purchasingGroup#994120, _extract_supplierSubrange#994121, _extract_mrpController#994122, _extract_orderDate#994123, _extract_supplier#994124, _extract_deliveryDate#994125, _extract_purchasingOrg#994126, _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510], false, [productOrderScheduleExploded#993532]
(158) Project
Output [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, productOrderScheduleExploded#993532.product AS product#993533, productOrderScheduleExploded#993532.orderDateTime AS orderDateTime#993534, productOrderScheduleExploded#993532.availabilityDateTime AS availabilityDateTime#993535, productOrderScheduleExploded#993532.nextAvailabilityDateTime AS nextAvailabilityDateTime#993536, productOrderScheduleExploded#993532.mrpController AS mrpController#993537, productOrderScheduleExploded#993532.sourceOfSupplyUuid AS sourceOfSupplyUuid#993538, productOrderScheduleExploded#993532.purchasingOrg AS purchasingOrg#993539, productOrderScheduleExploded#993532.purchasingGroup AS purchasingGroup#993540, productOrderScheduleExploded#993532.isFallbackOrderOnly AS isFallbackOrderOnly#993541, xxhash64(CASE WHEN (_extract_supplierSubrange#994114 <=> true) THEN effectiveSubrange#993507 END, orderGroupingProfile#993492, CASE WHEN (_extract_mrpController#994115 <=> true) THEN productOrderScheduleExploded#993532.mrpController END, CASE WHEN (_extract_purchasingOrg#994116 <=> true) THEN productOrderScheduleExploded#993532.purchasingOrg END, CASE WHEN (_extract_orderDate#994117 <=> true) THEN productOrderScheduleExploded#993532.orderDateTime END, CASE WHEN (_extract_deliveryDate#994118 <=> true) THEN deliveryDateTime#993483 END, CASE WHEN (_extract_supplier#994119 <=> true) THEN supplierOrGroup#993509 END, locationOrGroup#993510, CASE WHEN (_extract_purchasingGroup#994120 <=> true) THEN productOrderScheduleExploded#993532.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#993507) AND (_extract_supplierSubrange#994114 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#993492) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.mrpController) AND (_extract_mrpController#994115 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingOrg) AND (_extract_purchasingOrg#994116 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.orderDateTime) AND (_extract_orderDate#994117 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#993483) AND (_extract_deliveryDate#994118 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#993509) AND (_extract_supplier#994119 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#993510) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingGroup) AND (_extract_purchasingGroup#994120 <=> true)) THEN 256 ELSE 0 END), 10000002111, 42) AS orderProposalId#993568L, xxhash64(CASE WHEN (_extract_supplierSubrange#994121 <=> true) THEN effectiveSubrange#993507 END, orderGroupingProfile#993492, CASE WHEN (_extract_mrpController#994122 <=> true) THEN productOrderScheduleExploded#993532.mrpController END, CASE WHEN (_extract_orderDate#994123 <=> true) THEN productOrderScheduleExploded#993532.orderDateTime END, CASE WHEN (_extract_supplier#994124 <=> true) THEN supplier#993481 END, CASE WHEN (_extract_deliveryDate#994125 <=> true) THEN deliveryDateTime#993483 END, CASE WHEN (_extract_purchasingOrg#994126 <=> true) THEN productOrderScheduleExploded#993532.purchasingOrg END, plant#993482, CASE WHEN (_extract_purchasingGroup#994127 <=> true) THEN productOrderScheduleExploded#993532.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#993507) AND (_extract_supplierSubrange#994121 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#993492) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.mrpController) AND (_extract_mrpController#994122 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.orderDateTime) AND (_extract_orderDate#994123 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#993481) AND (_extract_supplier#994124 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#993483) AND (_extract_deliveryDate#994125 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingOrg) AND (_extract_purchasingOrg#994126 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#993482) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#993532.purchasingGroup) AND (_extract_purchasingGroup#994127 <=> true)) THEN 256 ELSE 0 END), 10000002111, 42) AS splitIndicator#993596L]
Input [26]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, effectiveSubrange#993507, _extract_supplierSubrange#994114, _extract_mrpController#994115, _extract_purchasingOrg#994116, _extract_orderDate#994117, _extract_deliveryDate#994118, _extract_supplier#994119, _extract_purchasingGroup#994120, _extract_supplierSubrange#994121, _extract_mrpController#994122, _extract_orderDate#994123, _extract_supplier#994124, _extract_deliveryDate#994125, _extract_purchasingOrg#994126, _extract_purchasingGroup#994127, orderGroupingProfile#993492, supplierOrGroup#993509, locationOrGroup#993510, productOrderScheduleExploded#993532]
(159) Exchange
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L]
Arguments: hashpartitioning(product#993533, plant#993482, 25), ENSURE_REQUIREMENTS, [plan_id=386724]
(160) Sort
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L]
Arguments: [product#993533 ASC NULLS FIRST, plant#993482 ASC NULLS FIRST, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST], false, 0
(161) Window
Input [18]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L]
Arguments: [lag(orderProposalId#993568L, -1, null) windowspecdefinition(product#993533, plant#993482, availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#993597L], [product#993533, plant#993482], [availabilityDateTime#993535 ASC NULLS FIRST, orderDateTime#993534 ASC NULLS FIRST, orderProposalId#993568L ASC NULLS FIRST]
(162) Project
Output [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, orderProposalId#993650L AS nodeId#993935L, previousOrderProposals#993652 AS dependentOnNodeIds#993936]
Input [4]: [clusterId#993655L, orderProposalId#993650L, plant#993651, previousOrderProposals#993652]
(163) Exchange
Input [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, nodeId#993935L, dependentOnNodeIds#993936]
Arguments: hashpartitioning(clusterId#993655L, 25), REPARTITION_BY_COL, [plan_id=386689]
(164) DeserializeToObject
Input [6]: [orderProposalId#993650L, plant#993651, previousOrderProposals#993652, clusterId#993655L, nodeId#993935L, dependentOnNodeIds#993936]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#993650L)), invoke(plant#993651.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#993652, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#993655L)), static_invoke(java.lang.Long.valueOf(nodeId#993935L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#993936, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#993949: org.apache.spark.sql.Row
(165) MapPartitions
Input [1]: [obj#993949]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@c7b81b4, obj#993957: org.apache.spark.sql.Row
(166) SerializeFromObject
Input [1]: [obj#993957]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#993965L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#993968L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#993971]
(167) BroadcastExchange
Input [3]: [orderProposalId#993965L, clusterId#993968L, sequenceId#993971]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=386728]
(168) BroadcastHashJoin
Left keys [1]: [orderProposalId#993568L]
Right keys [1]: [orderProposalId#993965L]
Join type: LeftOuter
Join condition: None
(169) Project
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, 0 AS orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, splitIndicator#993596L, previousOrderProposal#993597L, orderProposalId#993965L, clusterId#993968L, sequenceId#993971]
(170) AdaptiveSparkPlan
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: isFinalPlan=true
(171) TableCacheQueryStage
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: 0
(172) Exchange
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=387966]
(173) ShuffleQueryStage
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: 1
(174) ResultQueryStage
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: 2
(175) Exchange
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=387884]
(176) AdaptiveSparkPlan
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: isFinalPlan=true
(177) TableCacheQueryStage
Output [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: 0
(178) Sort [codegen id : 1]
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: [clusterId#993968L ASC NULLS FIRST], false, 0
(179) Window
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: [count(1) windowspecdefinition(clusterId#993968L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#995983L, max(sequenceId#993971) windowspecdefinition(clusterId#993968L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#995984], [clusterId#993968L]
(180) Project [codegen id : 2]
Output [23]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971, (cast(_we0#995983L as double) / cast((_we1#995984 + 1) as double)) AS avgItemsPerSequence#995980]
Input [24]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971, _we0#995983L, _we1#995984]
(181) DeserializeToObject
Input [23]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971, avgItemsPerSequence#995980]
Arguments: createexternalrow(invoke(supplierGroup#993480.toString()), invoke(supplier#993481.toString()), invoke(plant#993482.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#993483)), invoke(subrange#993484.toString()), invoke(supplyingPlant#993485.toString()), invoke(productGroup#993486.toString()), invoke(product#993533.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#993534)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#993535)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#993536)), invoke(mrpController#993537.toString()), invoke(sourceOfSupplyUuid#993538.toString()), invoke(purchasingOrg#993539.toString()), invoke(purchasingGroup#993540.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#993541)), static_invoke(java.lang.Long.valueOf(orderProposalId#993568L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#993569L)), static_invoke(java.lang.Long.valueOf(splitIndicator#993596L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#993597L)), static_invoke(java.lang.Long.valueOf(clusterId#993968L)), static_invoke(java.lang.Integer.valueOf(sequenceId#993971)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#995980)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#996031: org.apache.spark.sql.Row
(182) MapPartitions
Input [1]: [obj#996031]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@19876423, obj#996056: org.apache.spark.sql.Row
(183) SerializeFromObject [codegen id : 3]
Input [1]: [obj#996056]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#996081, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#996082, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#996083, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#996084, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#996085, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#996086, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#996087, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#996088, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#996089, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#996090, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#996091, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#996092, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#996093, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#996094, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#996095, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#996096, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#996097L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#996098L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#996099L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#996100L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#996101L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#996102, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#996103, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#996104]
(184) ResultQueryStage
Output [24]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, avgItemsPerSequence#996103, binId#996104]
Arguments: 1
(185) Exchange
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: hashpartitioning(clusterId#993968L, 25), ENSURE_REQUIREMENTS, [plan_id=387910]
(186) Sort
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: [clusterId#993968L ASC NULLS FIRST], false, 0
(187) Window
Input [22]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971]
Arguments: [count(1) windowspecdefinition(clusterId#993968L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#995983L, max(sequenceId#993971) windowspecdefinition(clusterId#993968L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#995984], [clusterId#993968L]
(188) Project
Output [23]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971, (cast(_we0#995983L as double) / cast((_we1#995984 + 1) as double)) AS avgItemsPerSequence#995980]
Input [24]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971, _we0#995983L, _we1#995984]
(189) DeserializeToObject
Input [23]: [supplierGroup#993480, supplier#993481, plant#993482, deliveryDateTime#993483, subrange#993484, supplyingPlant#993485, productGroup#993486, product#993533, orderDateTime#993534, availabilityDateTime#993535, nextAvailabilityDateTime#993536, mrpController#993537, sourceOfSupplyUuid#993538, purchasingOrg#993539, purchasingGroup#993540, isFallbackOrderOnly#993541, orderProposalId#993568L, orderProposalHorizonGroupingId#993569L, splitIndicator#993596L, previousOrderProposal#993597L, clusterId#993968L, sequenceId#993971, avgItemsPerSequence#995980]
Arguments: createexternalrow(invoke(supplierGroup#993480.toString()), invoke(supplier#993481.toString()), invoke(plant#993482.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#993483)), invoke(subrange#993484.toString()), invoke(supplyingPlant#993485.toString()), invoke(productGroup#993486.toString()), invoke(product#993533.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#993534)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#993535)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#993536)), invoke(mrpController#993537.toString()), invoke(sourceOfSupplyUuid#993538.toString()), invoke(purchasingOrg#993539.toString()), invoke(purchasingGroup#993540.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#993541)), static_invoke(java.lang.Long.valueOf(orderProposalId#993568L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#993569L)), static_invoke(java.lang.Long.valueOf(splitIndicator#993596L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#993597L)), static_invoke(java.lang.Long.valueOf(clusterId#993968L)), static_invoke(java.lang.Integer.valueOf(sequenceId#993971)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#995980)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#996031: org.apache.spark.sql.Row
(190) MapPartitions
Input [1]: [obj#996031]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@19876423, obj#996056: org.apache.spark.sql.Row
(191) SerializeFromObject
Input [1]: [obj#996056]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#996081, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#996082, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#996083, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#996084, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#996085, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#996086, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#996087, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#996088, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#996089, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#996090, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#996091, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#996092, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#996093, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#996094, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#996095, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#996096, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#996097L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#996098L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#996099L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#996100L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#996101L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#996102, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#996103, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#996104]
(192) AdaptiveSparkPlan
Output [24]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, avgItemsPerSequence#996103, binId#996104]
Arguments: isFinalPlan=true
(193) TableCacheQueryStage
Output [23]: [availabilityDateTime#996090, binId#996104, clusterId#996101L, deliveryDateTime#996084, isFallbackOrderOnly#996096, mrpController#996092, nextAvailabilityDateTime#996091, orderDateTime#996089, orderProposalHorizonGroupingId#996098L, orderProposalId#996097L, plant#996083, previousOrderProposal#996100L, product#996088, productGroup#996087, purchasingGroup#996095, purchasingOrg#996094, sequenceId#996102, sourceOfSupplyUuid#996093, splitIndicator#996099L, subrange#996085, supplier#996082, supplierGroup#996081, supplyingPlant#996086]
Arguments: 0
(194) Project [codegen id : 1]
Output [24]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, concat(0, _, cast(binId#996104 as string), _, 10000002111) AS shardId#996555, monotonically_increasing_id() AS worklistShardItemId#996556L]
Input [23]: [availabilityDateTime#996090, binId#996104, clusterId#996101L, deliveryDateTime#996084, isFallbackOrderOnly#996096, mrpController#996092, nextAvailabilityDateTime#996091, orderDateTime#996089, orderProposalHorizonGroupingId#996098L, orderProposalId#996097L, plant#996083, previousOrderProposal#996100L, product#996088, productGroup#996087, purchasingGroup#996095, purchasingOrg#996094, sequenceId#996102, sourceOfSupplyUuid#996093, splitIndicator#996099L, subrange#996085, supplier#996082, supplierGroup#996081, supplyingPlant#996086]
(195) Project [codegen id : 1]
Output [26]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, shardId#996555, worklistShardItemId#996556L, null AS orderProposalItemGroupId#996557, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#996558]
Input [24]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, shardId#996555, worklistShardItemId#996556L]
(196) ResultQueryStage
Output [26]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, shardId#996555, worklistShardItemId#996556L, orderProposalItemGroupId#996557, orderProposalItemId#996558]
Arguments: 1
(197) Project
Output [24]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, concat(0, _, cast(binId#996104 as string), _, 10000002111) AS shardId#996555, monotonically_increasing_id() AS worklistShardItemId#996556L]
Input [23]: [availabilityDateTime#996090, binId#996104, clusterId#996101L, deliveryDateTime#996084, isFallbackOrderOnly#996096, mrpController#996092, nextAvailabilityDateTime#996091, orderDateTime#996089, orderProposalHorizonGroupingId#996098L, orderProposalId#996097L, plant#996083, previousOrderProposal#996100L, product#996088, productGroup#996087, purchasingGroup#996095, purchasingOrg#996094, sequenceId#996102, sourceOfSupplyUuid#996093, splitIndicator#996099L, subrange#996085, supplier#996082, supplierGroup#996081, supplyingPlant#996086]
(198) Project
Output [26]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, shardId#996555, worklistShardItemId#996556L, null AS orderProposalItemGroupId#996557, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#996558]
Input [24]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, shardId#996555, worklistShardItemId#996556L]
(199) AdaptiveSparkPlan
Output [26]: [supplierGroup#996081, supplier#996082, plant#996083, deliveryDateTime#996084, subrange#996085, supplyingPlant#996086, productGroup#996087, product#996088, orderDateTime#996089, availabilityDateTime#996090, nextAvailabilityDateTime#996091, mrpController#996092, sourceOfSupplyUuid#996093, purchasingOrg#996094, purchasingGroup#996095, isFallbackOrderOnly#996096, orderProposalId#996097L, orderProposalHorizonGroupingId#996098L, splitIndicator#996099L, previousOrderProposal#996100L, clusterId#996101L, sequenceId#996102, shardId#996555, worklistShardItemId#996556L, orderProposalItemGroupId#996557, orderProposalItemId#996558]
Arguments: isFinalPlan=true
(200) TableCacheQueryStage
Output [2]: [sequenceId#996102, shardId#996555]
Arguments: 0
(201) HashAggregate [codegen id : 1]
Input [2]: [sequenceId#996102, shardId#996555]
Keys [1]: [shardId#996555]
Functions [1]: [partial_max(sequenceId#996102)]
Aggregate Attributes [1]: [max#999330]
Results [2]: [shardId#996555, max#999331]
(202) HashAggregate [codegen id : 1]
Input [2]: [shardId#996555, max#999331]
Keys [1]: [shardId#996555]
Functions [1]: [max(sequenceId#996102)]
Aggregate Attributes [1]: [max(sequenceId#996102)#998939]
Results [2]: [shardId#996555, max(sequenceId#996102)#998939 AS maxClusterSequenceId#998912]
(203) ResultQueryStage
Output [2]: [shardId#996555, maxClusterSequenceId#998912]
Arguments: 1
(204) HashAggregate
Input [2]: [sequenceId#996102, shardId#996555]
Keys [1]: [shardId#996555]
Functions [1]: [partial_max(sequenceId#996102)]
Aggregate Attributes [1]: [max#999330]
Results [2]: [shardId#996555, max#999331]
(205) HashAggregate
Input [2]: [shardId#996555, max#999331]
Keys [1]: [shardId#996555]
Functions [1]: [max(sequenceId#996102)]
Aggregate Attributes [1]: [max(sequenceId#996102)#998939]
Results [2]: [shardId#996555, max(sequenceId#996102)#998939 AS maxClusterSequenceId#998912]
(206) AdaptiveSparkPlan
Output [2]: [shardId#996555, maxClusterSequenceId#998912]
Arguments: isFinalPlan=true
| Name | Value |
|---|---|
| spark.activity.hdlfsEnabled | true |
| spark.activity.isolateSession | true |
| spark.sql.parquet.fieldId.read.enabled | true |
| spark.sql.parquet.fieldId.write.enabled | true |
| temporal.activity.id | 2baaefe6-1a56-3e5a-8f96-cfad9bd8af82 |
| temporal.activity.type | CreateOrderProposalShards |