== Physical Plan ==
AdaptiveSparkPlan (211)
+- == Final Plan ==
ResultQueryStage (206), Statistics(sizeInBytes=8.0 EiB)
+- Execute InsertIntoHadoopFsRelationCommand (205)
+- WriteFiles (204)
+- * Sort (203)
+- ShuffleQueryStage (202), Statistics(sizeInBytes=11.0 KiB, rowCount=24)
+- Exchange (201)
+- TableCacheQueryStage (200), Statistics(sizeInBytes=9.0 KiB, rowCount=24)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=8.4 KiB, rowCount=24)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Execute InsertIntoHadoopFsRelationCommand (210)
+- WriteFiles (209)
+- Sort (208)
+- Exchange (207)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=8.4 KiB, rowCount=24)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=9.7 KiB, rowCount=24)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=8.1 KiB, rowCount=24)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=8.9 KiB, rowCount=24)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=8.7 KiB, rowCount=18)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=6.0 KiB, rowCount=18)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=15)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1880.0 B, rowCount=15)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1760.0 B, rowCount=15)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1480.0 B, rowCount=15)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2.6 KiB, rowCount=24)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=8.2 KiB, rowCount=18)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=8.5 KiB, rowCount=18)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=18)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=4.5 KiB, rowCount=18)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=3.1 KiB, rowCount=18)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
(1) InMemoryTableScan
Output [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, ... 1 more fields]
(2) InMemoryRelation
Arguments: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, ... 1 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [23]: [availabilityDateTime#908808, binId#908822, clusterId#908819L, deliveryDateTime#908802, isFallbackOrderOnly#908814, mrpController#908810, nextAvailabilityDateTime#908809, orderDateTime#908807, orderProposalHorizonGroupingId#908816L, orderProposalId#908815L, plant#908801, previousOrderProposal#908818L, product#908806, productGroup#908805, purchasingGroup#908813, purchasingOrg#908812, sequenceId#908820, sourceOfSupplyUuid#908811, splitIndicator#908817L, subrange#908803, supplier#908800, supplierGroup#908799, supplyingPlant#908804]
Arguments: [availabilityDateTime#908808, binId#908822, clusterId#908819L, deliveryDateTime#908802, isFallbackOrderOnly#908814, mrpController#908810, nextAvailabilityDateTime#908809, orderDateTime#908807, orderProposalHorizonGroupingId#908816L, orderProposalId#908815L, plant#908801, previousOrderProposal#908818L, product#908806, productGroup#908805, purchasingGroup#908813, purchasingOrg#908812, sequenceId#908820, sourceOfSupplyUuid#908811, splitIndicator#908817L, subrange#908803, supplier#908800, supplierGroup#908799, supplyingPlant#908804]
(4) InMemoryRelation
Arguments: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, avgItemsPerSequence#908821, binId#908822], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
(6) InMemoryRelation
Arguments: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689], StorageLevel(disk, memory, 2 replicas)
(7) InMemoryTableScan
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
(8) InMemoryRelation
Arguments: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689], StorageLevel(disk, memory, 2 replicas)
(9) Scan parquet
Output [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002110]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(10) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
(11) Filter [codegen id : 1]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Condition : ((size(productOrderSchedule#906016, true) > 0) AND isnotnull(productOrderSchedule#906016))
(12) Exchange
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=354537]
(13) ShuffleQueryStage
Output [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Arguments: 0
(14) Project [codegen id : 5]
Output [9]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, CASE WHEN isnotnull(supplyingPlant#906014) THEN productGroup#906015 ELSE subrange#906013 END AS effectiveSubrange#906036]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
(15) Exchange
Input [9]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: hashpartitioning(coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012), 25), ENSURE_REQUIREMENTS, [plan_id=354888]
(16) ShuffleQueryStage
Output [9]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: 5
(17) AQEShuffleRead
Input [9]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: local
(18) Scan parquet
Output [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002110/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(19) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
(20) Exchange
Input [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=354553]
(21) ShuffleQueryStage
Output [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Arguments: 1
(22) Scan parquet
Output [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>,orderSplitCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,multiplesOrderQuantity:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(23) ColumnarToRow [codegen id : 3]
Input [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
(24) Filter [codegen id : 3]
Input [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Condition : isnotnull(orderGroupingProfile#906028)
(25) Exchange
Input [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=354566]
(26) ShuffleQueryStage
Output [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Arguments: 2
(27) BroadcastExchange
Input [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=354574]
(28) BroadcastQueryStage
Output [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Arguments: 7
(29) BroadcastHashJoin [codegen id : 7]
Left keys [1]: [orderGroupingProfile#906021]
Right keys [1]: [orderGroupingProfile#906028]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, subrange#906018 AS effectiveSubrange#906037]
Input [10]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
(31) Exchange
Input [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
Arguments: hashpartitioning(coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020), 25), ENSURE_REQUIREMENTS, [plan_id=355266]
(32) ShuffleQueryStage
Output [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
Arguments: 8
(33) AQEShuffleRead
Input [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
Arguments: local
(34) BroadcastExchange
Input [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[8, string, true], ), isnull(input[8, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=355344]
(35) BroadcastQueryStage
Output [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
Arguments: 9
(36) BroadcastHashJoin [codegen id : 8]
Left keys [10]: [coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012)]
Right keys [10]: [coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020)]
Join type: LeftOuter
Join condition: None
(37) Project [codegen id : 8]
Output [14]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, CASE WHEN isnull(orderGroupCriteria#906030) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#906030 END AS orderGroupCriteria#906049, CASE WHEN isnull(orderSplitCriteria#906031) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#906031 END AS orderSplitCriteria#906059, orderGroupingProfile#906021, coalesce(supplierGroup#906009, supplier#906010) AS supplierOrGroup#906038, coalesce(locationGroup#906023, plant#906011) AS locationOrGroup#906039]
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
(38) Project [codegen id : 8]
Output [26]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049.supplierSubrange AS _extract_supplierSubrange#906839, orderGroupCriteria#906049.mrpController AS _extract_mrpController#906840, orderGroupCriteria#906049.purchasingOrg AS _extract_purchasingOrg#906841, orderGroupCriteria#906049.orderDate AS _extract_orderDate#906842, orderGroupCriteria#906049.deliveryDate AS _extract_deliveryDate#906843, orderGroupCriteria#906049.supplier AS _extract_supplier#906844, orderGroupCriteria#906049.purchasingGroup AS _extract_purchasingGroup#906845, orderSplitCriteria#906059.supplierSubrange AS _extract_supplierSubrange#906832, orderSplitCriteria#906059.mrpController AS _extract_mrpController#906833, orderSplitCriteria#906059.orderDate AS _extract_orderDate#906834, orderSplitCriteria#906059.supplier AS _extract_supplier#906835, orderSplitCriteria#906059.deliveryDate AS _extract_deliveryDate#906836, orderSplitCriteria#906059.purchasingOrg AS _extract_purchasingOrg#906837, orderSplitCriteria#906059.purchasingGroup AS _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Input [14]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049, orderSplitCriteria#906059, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
(39) Generate [codegen id : 8]
Input [26]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, _extract_supplierSubrange#906839, _extract_mrpController#906840, _extract_purchasingOrg#906841, _extract_orderDate#906842, _extract_deliveryDate#906843, _extract_supplier#906844, _extract_purchasingGroup#906845, _extract_supplierSubrange#906832, _extract_mrpController#906833, _extract_orderDate#906834, _extract_supplier#906835, _extract_deliveryDate#906836, _extract_purchasingOrg#906837, _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Arguments: explode(productOrderSchedule#906016), [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, effectiveSubrange#906036, _extract_supplierSubrange#906839, _extract_mrpController#906840, _extract_purchasingOrg#906841, _extract_orderDate#906842, _extract_deliveryDate#906843, _extract_supplier#906844, _extract_purchasingGroup#906845, _extract_supplierSubrange#906832, _extract_mrpController#906833, _extract_orderDate#906834, _extract_supplier#906835, _extract_deliveryDate#906836, _extract_purchasingOrg#906837, _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039], false, [productOrderScheduleExploded#906061]
(40) Project [codegen id : 8]
Output [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderScheduleExploded#906061.product AS product#906062, productOrderScheduleExploded#906061.orderDateTime AS orderDateTime#906063, productOrderScheduleExploded#906061.availabilityDateTime AS availabilityDateTime#906064, productOrderScheduleExploded#906061.nextAvailabilityDateTime AS nextAvailabilityDateTime#906065, productOrderScheduleExploded#906061.mrpController AS mrpController#906066, productOrderScheduleExploded#906061.sourceOfSupplyUuid AS sourceOfSupplyUuid#906067, productOrderScheduleExploded#906061.purchasingOrg AS purchasingOrg#906068, productOrderScheduleExploded#906061.purchasingGroup AS purchasingGroup#906069, productOrderScheduleExploded#906061.isFallbackOrderOnly AS isFallbackOrderOnly#906070, xxhash64(CASE WHEN (_extract_supplierSubrange#906839 <=> true) THEN effectiveSubrange#906036 END, orderGroupingProfile#906021, CASE WHEN (_extract_mrpController#906840 <=> true) THEN productOrderScheduleExploded#906061.mrpController END, CASE WHEN (_extract_purchasingOrg#906841 <=> true) THEN productOrderScheduleExploded#906061.purchasingOrg END, CASE WHEN (_extract_orderDate#906842 <=> true) THEN productOrderScheduleExploded#906061.orderDateTime END, CASE WHEN (_extract_deliveryDate#906843 <=> true) THEN deliveryDateTime#906012 END, CASE WHEN (_extract_supplier#906844 <=> true) THEN supplierOrGroup#906038 END, locationOrGroup#906039, CASE WHEN (_extract_purchasingGroup#906845 <=> true) THEN productOrderScheduleExploded#906061.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#906036) AND (_extract_supplierSubrange#906839 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#906021) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.mrpController) AND (_extract_mrpController#906840 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingOrg) AND (_extract_purchasingOrg#906841 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.orderDateTime) AND (_extract_orderDate#906842 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#906012) AND (_extract_deliveryDate#906843 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#906038) AND (_extract_supplier#906844 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#906039) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingGroup) AND (_extract_purchasingGroup#906845 <=> true)) THEN 256 ELSE 0 END), 10000002110, 42) AS orderProposalId#906097L, xxhash64(CASE WHEN (_extract_supplierSubrange#906832 <=> true) THEN effectiveSubrange#906036 END, orderGroupingProfile#906021, CASE WHEN (_extract_mrpController#906833 <=> true) THEN productOrderScheduleExploded#906061.mrpController END, CASE WHEN (_extract_orderDate#906834 <=> true) THEN productOrderScheduleExploded#906061.orderDateTime END, CASE WHEN (_extract_supplier#906835 <=> true) THEN supplier#906010 END, CASE WHEN (_extract_deliveryDate#906836 <=> true) THEN deliveryDateTime#906012 END, CASE WHEN (_extract_purchasingOrg#906837 <=> true) THEN productOrderScheduleExploded#906061.purchasingOrg END, plant#906011, CASE WHEN (_extract_purchasingGroup#906838 <=> true) THEN productOrderScheduleExploded#906061.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#906036) AND (_extract_supplierSubrange#906832 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#906021) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.mrpController) AND (_extract_mrpController#906833 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.orderDateTime) AND (_extract_orderDate#906834 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#906010) AND (_extract_supplier#906835 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#906012) AND (_extract_deliveryDate#906836 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingOrg) AND (_extract_purchasingOrg#906837 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#906011) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingGroup) AND (_extract_purchasingGroup#906838 <=> true)) THEN 256 ELSE 0 END), 10000002110, 42) AS splitIndicator#906125L]
Input [26]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, effectiveSubrange#906036, _extract_supplierSubrange#906839, _extract_mrpController#906840, _extract_purchasingOrg#906841, _extract_orderDate#906842, _extract_deliveryDate#906843, _extract_supplier#906844, _extract_purchasingGroup#906845, _extract_supplierSubrange#906832, _extract_mrpController#906833, _extract_orderDate#906834, _extract_supplier#906835, _extract_deliveryDate#906836, _extract_purchasingOrg#906837, _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039, productOrderScheduleExploded#906061]
(41) Exchange
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L]
Arguments: hashpartitioning(product#906062, plant#906011, 25), ENSURE_REQUIREMENTS, [plan_id=355425]
(42) ShuffleQueryStage
Output [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L]
Arguments: 10
(43) Sort [codegen id : 9]
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L]
Arguments: [product#906062 ASC NULLS FIRST, plant#906011 ASC NULLS FIRST, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST], false, 0
(44) Window
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L]
Arguments: [lag(orderProposalId#906097L, -1, null) windowspecdefinition(product#906062, plant#906011, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#906126L], [product#906062, plant#906011], [availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST]
(45) InMemoryTableScan
Output [4]: [clusterId#906184L, orderProposalId#906179L, plant#906180, previousOrderProposals#906181]
Arguments: [clusterId#906184L, orderProposalId#906179L, plant#906180, previousOrderProposals#906181]
(46) InMemoryRelation
Arguments: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, nodeId#906182L, dependentOnNodeIds#906183, clusterId#906184L, unresolvedDependencies#906185], StorageLevel(disk, memory, 2 replicas)
(47) Scan parquet
Output [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002110]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(48) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
(49) Filter [codegen id : 1]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Condition : ((size(productOrderSchedule#906016, true) > 0) AND isnotnull(productOrderSchedule#906016))
(50) Exchange
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=353270]
(51) ShuffleQueryStage
Output [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Arguments: 0
(52) Project [codegen id : 4]
Output [6]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, CASE WHEN isnotnull(supplyingPlant#906014) THEN productGroup#906015 ELSE subrange#906013 END AS effectiveSubrange#906036]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
(53) Exchange
Input [6]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: hashpartitioning(coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012), 25), ENSURE_REQUIREMENTS, [plan_id=353541]
(54) ShuffleQueryStage
Output [6]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: 3
(55) AQEShuffleRead
Input [6]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: local
(56) Scan parquet
Output [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002110/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(57) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
(58) Exchange
Input [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=353286]
(59) ShuffleQueryStage
Output [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Arguments: 1
(60) Scan parquet
Output [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(61) ColumnarToRow [codegen id : 3]
Input [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
(62) Filter [codegen id : 3]
Input [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Condition : isnotnull(orderGroupingProfile#906028)
(63) Exchange
Input [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=353299]
(64) ShuffleQueryStage
Output [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Arguments: 2
(65) BroadcastExchange
Input [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=353307]
(66) BroadcastQueryStage
Output [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Arguments: 4
(67) BroadcastHashJoin [codegen id : 5]
Left keys [1]: [orderGroupingProfile#906021]
Right keys [1]: [orderGroupingProfile#906028]
Join type: LeftOuter
Join condition: None
(68) Project [codegen id : 5]
Output [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, subrange#906018 AS effectiveSubrange#906037]
Input [9]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupingProfile#906028, orderGroupCriteria#906030]
(69) Exchange
Input [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
Arguments: hashpartitioning(coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020), 25), ENSURE_REQUIREMENTS, [plan_id=353889]
(70) ShuffleQueryStage
Output [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
Arguments: 5
(71) AQEShuffleRead
Input [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
Arguments: local
(72) BroadcastExchange
Input [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[7, string, true], ), isnull(input[7, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=354013]
(73) BroadcastQueryStage
Output [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
Arguments: 6
(74) BroadcastHashJoin [codegen id : 6]
Left keys [10]: [coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012)]
Right keys [10]: [coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020)]
Join type: LeftOuter
Join condition: None
(75) Project [codegen id : 6]
Output [8]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, CASE WHEN isnull(orderGroupCriteria#906030) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#906030 END AS orderGroupCriteria#906049, orderGroupingProfile#906021, coalesce(supplierGroup#906009, supplier#906010) AS supplierOrGroup#906038, coalesce(locationGroup#906023, plant#906011) AS locationOrGroup#906039]
Input [14]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
(76) Project [codegen id : 6]
Output [14]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049.supplierSubrange AS _extract_supplierSubrange#906186, orderGroupCriteria#906049.mrpController AS _extract_mrpController#906187, orderGroupCriteria#906049.purchasingOrg AS _extract_purchasingOrg#906188, orderGroupCriteria#906049.orderDate AS _extract_orderDate#906189, orderGroupCriteria#906049.deliveryDate AS _extract_deliveryDate#906190, orderGroupCriteria#906049.supplier AS _extract_supplier#906191, orderGroupCriteria#906049.purchasingGroup AS _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Input [8]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
(77) Generate [codegen id : 6]
Input [14]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, _extract_supplierSubrange#906186, _extract_mrpController#906187, _extract_purchasingOrg#906188, _extract_orderDate#906189, _extract_deliveryDate#906190, _extract_supplier#906191, _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Arguments: explode(productOrderSchedule#906016), [plant#906011, deliveryDateTime#906012, effectiveSubrange#906036, _extract_supplierSubrange#906186, _extract_mrpController#906187, _extract_purchasingOrg#906188, _extract_orderDate#906189, _extract_deliveryDate#906190, _extract_supplier#906191, _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039], false, [productOrderScheduleExploded#906061]
(78) Project [codegen id : 6]
Output [5]: [plant#906011, productOrderScheduleExploded#906061.product AS product#906062, productOrderScheduleExploded#906061.orderDateTime AS orderDateTime#906063, productOrderScheduleExploded#906061.availabilityDateTime AS availabilityDateTime#906064, xxhash64(CASE WHEN (_extract_supplierSubrange#906186 <=> true) THEN effectiveSubrange#906036 END, orderGroupingProfile#906021, CASE WHEN (_extract_mrpController#906187 <=> true) THEN productOrderScheduleExploded#906061.mrpController END, CASE WHEN (_extract_purchasingOrg#906188 <=> true) THEN productOrderScheduleExploded#906061.purchasingOrg END, CASE WHEN (_extract_orderDate#906189 <=> true) THEN productOrderScheduleExploded#906061.orderDateTime END, CASE WHEN (_extract_deliveryDate#906190 <=> true) THEN deliveryDateTime#906012 END, CASE WHEN (_extract_supplier#906191 <=> true) THEN supplierOrGroup#906038 END, locationOrGroup#906039, CASE WHEN (_extract_purchasingGroup#906192 <=> true) THEN productOrderScheduleExploded#906061.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#906036) AND (_extract_supplierSubrange#906186 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#906021) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.mrpController) AND (_extract_mrpController#906187 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingOrg) AND (_extract_purchasingOrg#906188 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.orderDateTime) AND (_extract_orderDate#906189 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#906012) AND (_extract_deliveryDate#906190 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#906038) AND (_extract_supplier#906191 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#906039) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingGroup) AND (_extract_purchasingGroup#906192 <=> true)) THEN 256 ELSE 0 END), 10000002110, 42) AS orderProposalId#906097L]
Input [14]: [plant#906011, deliveryDateTime#906012, effectiveSubrange#906036, _extract_supplierSubrange#906186, _extract_mrpController#906187, _extract_purchasingOrg#906188, _extract_orderDate#906189, _extract_deliveryDate#906190, _extract_supplier#906191, _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039, productOrderScheduleExploded#906061]
(79) Exchange
Input [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: hashpartitioning(product#906062, plant#906011, 25), ENSURE_REQUIREMENTS, [plan_id=354140]
(80) ShuffleQueryStage
Output [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: 7
(81) AQEShuffleRead
Input [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: coalesced
(82) Sort [codegen id : 7]
Input [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: [product#906062 ASC NULLS FIRST, plant#906011 ASC NULLS FIRST, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST], false, 0
(83) Window
Input [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: [lag(orderProposalId#906097L, -1, null) windowspecdefinition(product#906062, plant#906011, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#906126L], [product#906062, plant#906011], [availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST]
(84) Project [codegen id : 8]
Output [3]: [plant#906011, orderProposalId#906097L, previousOrderProposal#906126L]
Input [6]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L, previousOrderProposal#906126L]
(85) ObjectHashAggregate
Input [3]: [plant#906011, orderProposalId#906097L, previousOrderProposal#906126L]
Keys [1]: [orderProposalId#906097L]
Functions [2]: [partial_min(plant#906011), partial_collect_set(previousOrderProposal#906126L, 0, 0)]
Aggregate Attributes [2]: [min#906450, buf#906451]
Results [3]: [orderProposalId#906097L, min#906452, buf#906453]
(86) Exchange
Input [3]: [orderProposalId#906097L, min#906452, buf#906453]
Arguments: hashpartitioning(orderProposalId#906097L, 25), ENSURE_REQUIREMENTS, [plan_id=354238]
(87) ShuffleQueryStage
Output [3]: [orderProposalId#906097L, min#906452, buf#906453]
Arguments: 8
(88) AQEShuffleRead
Input [3]: [orderProposalId#906097L, min#906452, buf#906453]
Arguments: coalesced
(89) ObjectHashAggregate
Input [3]: [orderProposalId#906097L, min#906452, buf#906453]
Keys [1]: [orderProposalId#906097L]
Functions [2]: [min(plant#906011), collect_set(previousOrderProposal#906126L, 0, 0)]
Aggregate Attributes [2]: [min(plant#906011)#906149, collect_set(previousOrderProposal#906126L, 0, 0)#906150]
Results [4]: [orderProposalId#906097L, min(plant#906011)#906149 AS plant#906127, collect_set(previousOrderProposal#906126L, 0, 0)#906150 AS previousOrderProposals#906128, orderProposalId#906097L AS nodeId#906151L]
(90) Project [codegen id : 9]
Output [5]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L, previousOrderProposals#906128 AS dependentOnNodeIds#906152]
Input [4]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L]
(91) Exchange
Input [5]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L, dependentOnNodeIds#906152]
Arguments: hashpartitioning(plant#906127, 25), REPARTITION_BY_COL, [plan_id=354290]
(92) ShuffleQueryStage
Output [5]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L, dependentOnNodeIds#906152]
Arguments: 9
(93) DeserializeToObject
Input [5]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L, dependentOnNodeIds#906152]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#906097L)), invoke(plant#906127.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#906128, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#906151L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#906152, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#906163: org.apache.spark.sql.Row
(94) MapPartitions
Input [1]: [obj#906163]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@f9c64cd, obj#906171: org.apache.spark.sql.Row
(95) SerializeFromObject [codegen id : 10]
Input [1]: [obj#906171]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#906179L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#906180, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#906181, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#906182L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#906183, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#906184L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#906185]
(96) ResultQueryStage
Output [7]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, nodeId#906182L, dependentOnNodeIds#906183, clusterId#906184L, unresolvedDependencies#906185]
Arguments: 10
(97) Filter
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Condition : ((size(productOrderSchedule#906016, true) > 0) AND isnotnull(productOrderSchedule#906016))
(98) Exchange
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=353148]
(99) Project
Output [6]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, CASE WHEN isnotnull(supplyingPlant#906014) THEN productGroup#906015 ELSE subrange#906013 END AS effectiveSubrange#906036]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
(100) Exchange
Input [6]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: hashpartitioning(coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012), 25), ENSURE_REQUIREMENTS, [plan_id=353172]
(101) Sort
Input [6]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: [coalesce(supplierGroup#906009, ) ASC NULLS FIRST, isnull(supplierGroup#906009) ASC NULLS FIRST, coalesce(supplier#906010, ) ASC NULLS FIRST, isnull(supplier#906010) ASC NULLS FIRST, coalesce(effectiveSubrange#906036, ) ASC NULLS FIRST, isnull(effectiveSubrange#906036) ASC NULLS FIRST, coalesce(plant#906011, ) ASC NULLS FIRST, isnull(plant#906011) ASC NULLS FIRST, coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#906012) ASC NULLS FIRST], false, 0
(102) Exchange
Input [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=353126]
(103) Filter
Input [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Condition : isnotnull(orderGroupingProfile#906028)
(104) Exchange
Input [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=353150]
(105) BroadcastExchange
Input [2]: [orderGroupingProfile#906028, orderGroupCriteria#906030]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=353167]
(106) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#906021]
Right keys [1]: [orderGroupingProfile#906028]
Join type: LeftOuter
Join condition: None
(107) Project
Output [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, subrange#906018 AS effectiveSubrange#906037]
Input [9]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupingProfile#906028, orderGroupCriteria#906030]
(108) Exchange
Input [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
Arguments: hashpartitioning(coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020), 25), ENSURE_REQUIREMENTS, [plan_id=353173]
(109) Sort
Input [8]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
Arguments: [coalesce(supplierGroup#906022, ) ASC NULLS FIRST, isnull(supplierGroup#906022) ASC NULLS FIRST, coalesce(supplier#906017, ) ASC NULLS FIRST, isnull(supplier#906017) ASC NULLS FIRST, coalesce(effectiveSubrange#906037, ) ASC NULLS FIRST, isnull(effectiveSubrange#906037) ASC NULLS FIRST, coalesce(plant#906019, ) ASC NULLS FIRST, isnull(plant#906019) ASC NULLS FIRST, coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#906020) ASC NULLS FIRST], false, 0
(110) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012)]
Right keys [10]: [coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020)]
Join type: LeftOuter
Join condition: None
(111) Project
Output [8]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, CASE WHEN isnull(orderGroupCriteria#906030) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#906030 END AS orderGroupCriteria#906049, orderGroupingProfile#906021, coalesce(supplierGroup#906009, supplier#906010) AS supplierOrGroup#906038, coalesce(locationGroup#906023, plant#906011) AS locationOrGroup#906039]
Input [14]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, effectiveSubrange#906037]
(112) Project
Output [14]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049.supplierSubrange AS _extract_supplierSubrange#906186, orderGroupCriteria#906049.mrpController AS _extract_mrpController#906187, orderGroupCriteria#906049.purchasingOrg AS _extract_purchasingOrg#906188, orderGroupCriteria#906049.orderDate AS _extract_orderDate#906189, orderGroupCriteria#906049.deliveryDate AS _extract_deliveryDate#906190, orderGroupCriteria#906049.supplier AS _extract_supplier#906191, orderGroupCriteria#906049.purchasingGroup AS _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Input [8]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
(113) Generate
Input [14]: [plant#906011, deliveryDateTime#906012, productOrderSchedule#906016, effectiveSubrange#906036, _extract_supplierSubrange#906186, _extract_mrpController#906187, _extract_purchasingOrg#906188, _extract_orderDate#906189, _extract_deliveryDate#906190, _extract_supplier#906191, _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Arguments: explode(productOrderSchedule#906016), [plant#906011, deliveryDateTime#906012, effectiveSubrange#906036, _extract_supplierSubrange#906186, _extract_mrpController#906187, _extract_purchasingOrg#906188, _extract_orderDate#906189, _extract_deliveryDate#906190, _extract_supplier#906191, _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039], false, [productOrderScheduleExploded#906061]
(114) Project
Output [5]: [plant#906011, productOrderScheduleExploded#906061.product AS product#906062, productOrderScheduleExploded#906061.orderDateTime AS orderDateTime#906063, productOrderScheduleExploded#906061.availabilityDateTime AS availabilityDateTime#906064, xxhash64(CASE WHEN (_extract_supplierSubrange#906186 <=> true) THEN effectiveSubrange#906036 END, orderGroupingProfile#906021, CASE WHEN (_extract_mrpController#906187 <=> true) THEN productOrderScheduleExploded#906061.mrpController END, CASE WHEN (_extract_purchasingOrg#906188 <=> true) THEN productOrderScheduleExploded#906061.purchasingOrg END, CASE WHEN (_extract_orderDate#906189 <=> true) THEN productOrderScheduleExploded#906061.orderDateTime END, CASE WHEN (_extract_deliveryDate#906190 <=> true) THEN deliveryDateTime#906012 END, CASE WHEN (_extract_supplier#906191 <=> true) THEN supplierOrGroup#906038 END, locationOrGroup#906039, CASE WHEN (_extract_purchasingGroup#906192 <=> true) THEN productOrderScheduleExploded#906061.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#906036) AND (_extract_supplierSubrange#906186 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#906021) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.mrpController) AND (_extract_mrpController#906187 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingOrg) AND (_extract_purchasingOrg#906188 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.orderDateTime) AND (_extract_orderDate#906189 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#906012) AND (_extract_deliveryDate#906190 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#906038) AND (_extract_supplier#906191 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#906039) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingGroup) AND (_extract_purchasingGroup#906192 <=> true)) THEN 256 ELSE 0 END), 10000002110, 42) AS orderProposalId#906097L]
Input [14]: [plant#906011, deliveryDateTime#906012, effectiveSubrange#906036, _extract_supplierSubrange#906186, _extract_mrpController#906187, _extract_purchasingOrg#906188, _extract_orderDate#906189, _extract_deliveryDate#906190, _extract_supplier#906191, _extract_purchasingGroup#906192, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039, productOrderScheduleExploded#906061]
(115) Exchange
Input [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: hashpartitioning(product#906062, plant#906011, 25), ENSURE_REQUIREMENTS, [plan_id=353182]
(116) Sort
Input [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: [product#906062 ASC NULLS FIRST, plant#906011 ASC NULLS FIRST, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST], false, 0
(117) Window
Input [5]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L]
Arguments: [lag(orderProposalId#906097L, -1, null) windowspecdefinition(product#906062, plant#906011, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#906126L], [product#906062, plant#906011], [availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST]
(118) Project
Output [3]: [plant#906011, orderProposalId#906097L, previousOrderProposal#906126L]
Input [6]: [plant#906011, product#906062, orderDateTime#906063, availabilityDateTime#906064, orderProposalId#906097L, previousOrderProposal#906126L]
(119) ObjectHashAggregate
Input [3]: [plant#906011, orderProposalId#906097L, previousOrderProposal#906126L]
Keys [1]: [orderProposalId#906097L]
Functions [2]: [partial_min(plant#906011), partial_collect_set(previousOrderProposal#906126L, 0, 0)]
Aggregate Attributes [2]: [min#906450, buf#906451]
Results [3]: [orderProposalId#906097L, min#906452, buf#906453]
(120) Exchange
Input [3]: [orderProposalId#906097L, min#906452, buf#906453]
Arguments: hashpartitioning(orderProposalId#906097L, 25), ENSURE_REQUIREMENTS, [plan_id=353188]
(121) ObjectHashAggregate
Input [3]: [orderProposalId#906097L, min#906452, buf#906453]
Keys [1]: [orderProposalId#906097L]
Functions [2]: [min(plant#906011), collect_set(previousOrderProposal#906126L, 0, 0)]
Aggregate Attributes [2]: [min(plant#906011)#906149, collect_set(previousOrderProposal#906126L, 0, 0)#906150]
Results [4]: [orderProposalId#906097L, min(plant#906011)#906149 AS plant#906127, collect_set(previousOrderProposal#906126L, 0, 0)#906150 AS previousOrderProposals#906128, orderProposalId#906097L AS nodeId#906151L]
(122) Project
Output [5]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L, previousOrderProposals#906128 AS dependentOnNodeIds#906152]
Input [4]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L]
(123) Exchange
Input [5]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L, dependentOnNodeIds#906152]
Arguments: hashpartitioning(plant#906127, 25), REPARTITION_BY_COL, [plan_id=353191]
(124) DeserializeToObject
Input [5]: [orderProposalId#906097L, plant#906127, previousOrderProposals#906128, nodeId#906151L, dependentOnNodeIds#906152]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#906097L)), invoke(plant#906127.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#906128, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#906151L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#906152, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#906163: org.apache.spark.sql.Row
(125) MapPartitions
Input [1]: [obj#906163]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@f9c64cd, obj#906171: org.apache.spark.sql.Row
(126) SerializeFromObject
Input [1]: [obj#906171]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#906179L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#906180, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#906181, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#906182L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#906183, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#906184L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#906185]
(127) AdaptiveSparkPlan
Output [7]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, nodeId#906182L, dependentOnNodeIds#906183, clusterId#906184L, unresolvedDependencies#906185]
Arguments: isFinalPlan=true
(128) TableCacheQueryStage
Output [4]: [clusterId#906184L, orderProposalId#906179L, plant#906180, previousOrderProposals#906181]
Arguments: 3
(129) Project [codegen id : 4]
Output [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, orderProposalId#906179L AS nodeId#906653L, previousOrderProposals#906181 AS dependentOnNodeIds#906654]
Input [4]: [clusterId#906184L, orderProposalId#906179L, plant#906180, previousOrderProposals#906181]
(130) Exchange
Input [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, nodeId#906653L, dependentOnNodeIds#906654]
Arguments: hashpartitioning(clusterId#906184L, 25), REPARTITION_BY_COL, [plan_id=354723]
(131) ShuffleQueryStage
Output [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, nodeId#906653L, dependentOnNodeIds#906654]
Arguments: 4
(132) AQEShuffleRead
Input [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, nodeId#906653L, dependentOnNodeIds#906654]
Arguments: coalesced
(133) DeserializeToObject
Input [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, nodeId#906653L, dependentOnNodeIds#906654]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#906179L)), invoke(plant#906180.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#906181, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#906184L)), static_invoke(java.lang.Long.valueOf(nodeId#906653L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#906654, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#906667: org.apache.spark.sql.Row
(134) MapPartitions
Input [1]: [obj#906667]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@576f7382, obj#906675: org.apache.spark.sql.Row
(135) SerializeFromObject [codegen id : 6]
Input [1]: [obj#906675]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#906683L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#906686L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#906689]
(136) BroadcastExchange
Input [3]: [orderProposalId#906683L, clusterId#906686L, sequenceId#906689]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=354996]
(137) BroadcastQueryStage
Output [3]: [orderProposalId#906683L, clusterId#906686L, sequenceId#906689]
Arguments: 6
(138) BroadcastHashJoin [codegen id : 10]
Left keys [1]: [orderProposalId#906097L]
Right keys [1]: [orderProposalId#906683L]
Join type: LeftOuter
Join condition: None
(139) Project [codegen id : 10]
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, 0 AS orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L, previousOrderProposal#906126L, orderProposalId#906683L, clusterId#906686L, sequenceId#906689]
(140) ResultQueryStage
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: 11
(141) Filter
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Condition : ((size(productOrderSchedule#906016, true) > 0) AND isnotnull(productOrderSchedule#906016))
(142) Exchange
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=354437]
(143) Project
Output [9]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, CASE WHEN isnotnull(supplyingPlant#906014) THEN productGroup#906015 ELSE subrange#906013 END AS effectiveSubrange#906036]
Input [8]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016]
(144) Exchange
Input [9]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: hashpartitioning(coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012), 25), ENSURE_REQUIREMENTS, [plan_id=354455]
(145) Sort
Input [9]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036]
Arguments: [coalesce(supplierGroup#906009, ) ASC NULLS FIRST, isnull(supplierGroup#906009) ASC NULLS FIRST, coalesce(supplier#906010, ) ASC NULLS FIRST, isnull(supplier#906010) ASC NULLS FIRST, coalesce(effectiveSubrange#906036, ) ASC NULLS FIRST, isnull(effectiveSubrange#906036) ASC NULLS FIRST, coalesce(plant#906011, ) ASC NULLS FIRST, isnull(plant#906011) ASC NULLS FIRST, coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#906012) ASC NULLS FIRST], false, 0
(146) Exchange
Input [7]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=354415]
(147) Filter
Input [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Condition : isnotnull(orderGroupingProfile#906028)
(148) Exchange
Input [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=354439]
(149) BroadcastExchange
Input [3]: [orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=354450]
(150) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#906021]
Right keys [1]: [orderGroupingProfile#906028]
Join type: LeftOuter
Join condition: None
(151) Project
Output [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, subrange#906018 AS effectiveSubrange#906037]
Input [10]: [supplier#906017, subrange#906018, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupingProfile#906028, orderGroupCriteria#906030, orderSplitCriteria#906031]
(152) Exchange
Input [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
Arguments: hashpartitioning(coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020), 25), ENSURE_REQUIREMENTS, [plan_id=354456]
(153) Sort
Input [9]: [supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
Arguments: [coalesce(supplierGroup#906022, ) ASC NULLS FIRST, isnull(supplierGroup#906022) ASC NULLS FIRST, coalesce(supplier#906017, ) ASC NULLS FIRST, isnull(supplier#906017) ASC NULLS FIRST, coalesce(effectiveSubrange#906037, ) ASC NULLS FIRST, isnull(effectiveSubrange#906037) ASC NULLS FIRST, coalesce(plant#906019, ) ASC NULLS FIRST, isnull(plant#906019) ASC NULLS FIRST, coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#906020) ASC NULLS FIRST], false, 0
(154) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#906009, ), isnull(supplierGroup#906009), coalesce(supplier#906010, ), isnull(supplier#906010), coalesce(effectiveSubrange#906036, ), isnull(effectiveSubrange#906036), coalesce(plant#906011, ), isnull(plant#906011), coalesce(deliveryDateTime#906012, 1970-01-01 00:00:00), isnull(deliveryDateTime#906012)]
Right keys [10]: [coalesce(supplierGroup#906022, ), isnull(supplierGroup#906022), coalesce(supplier#906017, ), isnull(supplier#906017), coalesce(effectiveSubrange#906037, ), isnull(effectiveSubrange#906037), coalesce(plant#906019, ), isnull(plant#906019), coalesce(deliveryDateTime#906020, 1970-01-01 00:00:00), isnull(deliveryDateTime#906020)]
Join type: LeftOuter
Join condition: None
(155) Project
Output [14]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, CASE WHEN isnull(orderGroupCriteria#906030) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#906030 END AS orderGroupCriteria#906049, CASE WHEN isnull(orderSplitCriteria#906031) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#906031 END AS orderSplitCriteria#906059, orderGroupingProfile#906021, coalesce(supplierGroup#906009, supplier#906010) AS supplierOrGroup#906038, coalesce(locationGroup#906023, plant#906011) AS locationOrGroup#906039]
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, supplier#906017, plant#906019, deliverydatetime#906020, ordergroupingprofile#906021, supplierGroup#906022, locationGroup#906023, orderGroupCriteria#906030, orderSplitCriteria#906031, effectiveSubrange#906037]
(156) Project
Output [26]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049.supplierSubrange AS _extract_supplierSubrange#906839, orderGroupCriteria#906049.mrpController AS _extract_mrpController#906840, orderGroupCriteria#906049.purchasingOrg AS _extract_purchasingOrg#906841, orderGroupCriteria#906049.orderDate AS _extract_orderDate#906842, orderGroupCriteria#906049.deliveryDate AS _extract_deliveryDate#906843, orderGroupCriteria#906049.supplier AS _extract_supplier#906844, orderGroupCriteria#906049.purchasingGroup AS _extract_purchasingGroup#906845, orderSplitCriteria#906059.supplierSubrange AS _extract_supplierSubrange#906832, orderSplitCriteria#906059.mrpController AS _extract_mrpController#906833, orderSplitCriteria#906059.orderDate AS _extract_orderDate#906834, orderSplitCriteria#906059.supplier AS _extract_supplier#906835, orderSplitCriteria#906059.deliveryDate AS _extract_deliveryDate#906836, orderSplitCriteria#906059.purchasingOrg AS _extract_purchasingOrg#906837, orderSplitCriteria#906059.purchasingGroup AS _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Input [14]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, orderGroupCriteria#906049, orderSplitCriteria#906059, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
(157) Generate
Input [26]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderSchedule#906016, effectiveSubrange#906036, _extract_supplierSubrange#906839, _extract_mrpController#906840, _extract_purchasingOrg#906841, _extract_orderDate#906842, _extract_deliveryDate#906843, _extract_supplier#906844, _extract_purchasingGroup#906845, _extract_supplierSubrange#906832, _extract_mrpController#906833, _extract_orderDate#906834, _extract_supplier#906835, _extract_deliveryDate#906836, _extract_purchasingOrg#906837, _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039]
Arguments: explode(productOrderSchedule#906016), [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, effectiveSubrange#906036, _extract_supplierSubrange#906839, _extract_mrpController#906840, _extract_purchasingOrg#906841, _extract_orderDate#906842, _extract_deliveryDate#906843, _extract_supplier#906844, _extract_purchasingGroup#906845, _extract_supplierSubrange#906832, _extract_mrpController#906833, _extract_orderDate#906834, _extract_supplier#906835, _extract_deliveryDate#906836, _extract_purchasingOrg#906837, _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039], false, [productOrderScheduleExploded#906061]
(158) Project
Output [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, productOrderScheduleExploded#906061.product AS product#906062, productOrderScheduleExploded#906061.orderDateTime AS orderDateTime#906063, productOrderScheduleExploded#906061.availabilityDateTime AS availabilityDateTime#906064, productOrderScheduleExploded#906061.nextAvailabilityDateTime AS nextAvailabilityDateTime#906065, productOrderScheduleExploded#906061.mrpController AS mrpController#906066, productOrderScheduleExploded#906061.sourceOfSupplyUuid AS sourceOfSupplyUuid#906067, productOrderScheduleExploded#906061.purchasingOrg AS purchasingOrg#906068, productOrderScheduleExploded#906061.purchasingGroup AS purchasingGroup#906069, productOrderScheduleExploded#906061.isFallbackOrderOnly AS isFallbackOrderOnly#906070, xxhash64(CASE WHEN (_extract_supplierSubrange#906839 <=> true) THEN effectiveSubrange#906036 END, orderGroupingProfile#906021, CASE WHEN (_extract_mrpController#906840 <=> true) THEN productOrderScheduleExploded#906061.mrpController END, CASE WHEN (_extract_purchasingOrg#906841 <=> true) THEN productOrderScheduleExploded#906061.purchasingOrg END, CASE WHEN (_extract_orderDate#906842 <=> true) THEN productOrderScheduleExploded#906061.orderDateTime END, CASE WHEN (_extract_deliveryDate#906843 <=> true) THEN deliveryDateTime#906012 END, CASE WHEN (_extract_supplier#906844 <=> true) THEN supplierOrGroup#906038 END, locationOrGroup#906039, CASE WHEN (_extract_purchasingGroup#906845 <=> true) THEN productOrderScheduleExploded#906061.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#906036) AND (_extract_supplierSubrange#906839 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#906021) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.mrpController) AND (_extract_mrpController#906840 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingOrg) AND (_extract_purchasingOrg#906841 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.orderDateTime) AND (_extract_orderDate#906842 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#906012) AND (_extract_deliveryDate#906843 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#906038) AND (_extract_supplier#906844 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#906039) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingGroup) AND (_extract_purchasingGroup#906845 <=> true)) THEN 256 ELSE 0 END), 10000002110, 42) AS orderProposalId#906097L, xxhash64(CASE WHEN (_extract_supplierSubrange#906832 <=> true) THEN effectiveSubrange#906036 END, orderGroupingProfile#906021, CASE WHEN (_extract_mrpController#906833 <=> true) THEN productOrderScheduleExploded#906061.mrpController END, CASE WHEN (_extract_orderDate#906834 <=> true) THEN productOrderScheduleExploded#906061.orderDateTime END, CASE WHEN (_extract_supplier#906835 <=> true) THEN supplier#906010 END, CASE WHEN (_extract_deliveryDate#906836 <=> true) THEN deliveryDateTime#906012 END, CASE WHEN (_extract_purchasingOrg#906837 <=> true) THEN productOrderScheduleExploded#906061.purchasingOrg END, plant#906011, CASE WHEN (_extract_purchasingGroup#906838 <=> true) THEN productOrderScheduleExploded#906061.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#906036) AND (_extract_supplierSubrange#906832 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#906021) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.mrpController) AND (_extract_mrpController#906833 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.orderDateTime) AND (_extract_orderDate#906834 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#906010) AND (_extract_supplier#906835 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#906012) AND (_extract_deliveryDate#906836 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingOrg) AND (_extract_purchasingOrg#906837 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#906011) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#906061.purchasingGroup) AND (_extract_purchasingGroup#906838 <=> true)) THEN 256 ELSE 0 END), 10000002110, 42) AS splitIndicator#906125L]
Input [26]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, effectiveSubrange#906036, _extract_supplierSubrange#906839, _extract_mrpController#906840, _extract_purchasingOrg#906841, _extract_orderDate#906842, _extract_deliveryDate#906843, _extract_supplier#906844, _extract_purchasingGroup#906845, _extract_supplierSubrange#906832, _extract_mrpController#906833, _extract_orderDate#906834, _extract_supplier#906835, _extract_deliveryDate#906836, _extract_purchasingOrg#906837, _extract_purchasingGroup#906838, orderGroupingProfile#906021, supplierOrGroup#906038, locationOrGroup#906039, productOrderScheduleExploded#906061]
(159) Exchange
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L]
Arguments: hashpartitioning(product#906062, plant#906011, 25), ENSURE_REQUIREMENTS, [plan_id=354465]
(160) Sort
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L]
Arguments: [product#906062 ASC NULLS FIRST, plant#906011 ASC NULLS FIRST, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST], false, 0
(161) Window
Input [18]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L]
Arguments: [lag(orderProposalId#906097L, -1, null) windowspecdefinition(product#906062, plant#906011, availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#906126L], [product#906062, plant#906011], [availabilityDateTime#906064 ASC NULLS FIRST, orderDateTime#906063 ASC NULLS FIRST, orderProposalId#906097L ASC NULLS FIRST]
(162) Project
Output [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, orderProposalId#906179L AS nodeId#906653L, previousOrderProposals#906181 AS dependentOnNodeIds#906654]
Input [4]: [clusterId#906184L, orderProposalId#906179L, plant#906180, previousOrderProposals#906181]
(163) Exchange
Input [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, nodeId#906653L, dependentOnNodeIds#906654]
Arguments: hashpartitioning(clusterId#906184L, 25), REPARTITION_BY_COL, [plan_id=354430]
(164) DeserializeToObject
Input [6]: [orderProposalId#906179L, plant#906180, previousOrderProposals#906181, clusterId#906184L, nodeId#906653L, dependentOnNodeIds#906654]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#906179L)), invoke(plant#906180.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#906181, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#906184L)), static_invoke(java.lang.Long.valueOf(nodeId#906653L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#906654, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#906667: org.apache.spark.sql.Row
(165) MapPartitions
Input [1]: [obj#906667]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@576f7382, obj#906675: org.apache.spark.sql.Row
(166) SerializeFromObject
Input [1]: [obj#906675]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#906683L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#906686L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#906689]
(167) BroadcastExchange
Input [3]: [orderProposalId#906683L, clusterId#906686L, sequenceId#906689]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=354469]
(168) BroadcastHashJoin
Left keys [1]: [orderProposalId#906097L]
Right keys [1]: [orderProposalId#906683L]
Join type: LeftOuter
Join condition: None
(169) Project
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, 0 AS orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, splitIndicator#906125L, previousOrderProposal#906126L, orderProposalId#906683L, clusterId#906686L, sequenceId#906689]
(170) AdaptiveSparkPlan
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: isFinalPlan=true
(171) TableCacheQueryStage
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: 0
(172) Exchange
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=355705]
(173) ShuffleQueryStage
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: 1
(174) ResultQueryStage
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: 2
(175) Exchange
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=355623]
(176) AdaptiveSparkPlan
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: isFinalPlan=true
(177) TableCacheQueryStage
Output [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: 0
(178) Sort [codegen id : 1]
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: [clusterId#906686L ASC NULLS FIRST], false, 0
(179) Window
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: [count(1) windowspecdefinition(clusterId#906686L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#908701L, max(sequenceId#906689) windowspecdefinition(clusterId#906686L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#908702], [clusterId#906686L]
(180) Project [codegen id : 2]
Output [23]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689, (cast(_we0#908701L as double) / cast((_we1#908702 + 1) as double)) AS avgItemsPerSequence#908698]
Input [24]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689, _we0#908701L, _we1#908702]
(181) DeserializeToObject
Input [23]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689, avgItemsPerSequence#908698]
Arguments: createexternalrow(invoke(supplierGroup#906009.toString()), invoke(supplier#906010.toString()), invoke(plant#906011.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#906012)), invoke(subrange#906013.toString()), invoke(supplyingPlant#906014.toString()), invoke(productGroup#906015.toString()), invoke(product#906062.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#906063)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#906064)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#906065)), invoke(mrpController#906066.toString()), invoke(sourceOfSupplyUuid#906067.toString()), invoke(purchasingOrg#906068.toString()), invoke(purchasingGroup#906069.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#906070)), static_invoke(java.lang.Long.valueOf(orderProposalId#906097L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#906098L)), static_invoke(java.lang.Long.valueOf(splitIndicator#906125L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#906126L)), static_invoke(java.lang.Long.valueOf(clusterId#906686L)), static_invoke(java.lang.Integer.valueOf(sequenceId#906689)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#908698)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#908749: org.apache.spark.sql.Row
(182) MapPartitions
Input [1]: [obj#908749]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@4d8330dd, obj#908774: org.apache.spark.sql.Row
(183) SerializeFromObject [codegen id : 3]
Input [1]: [obj#908774]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#908799, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#908800, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#908801, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#908802, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#908803, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#908804, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#908805, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#908806, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#908807, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#908808, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#908809, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#908810, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#908811, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#908812, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#908813, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#908814, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#908815L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#908816L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#908817L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#908818L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#908819L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#908820, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#908821, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#908822]
(184) ResultQueryStage
Output [24]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, avgItemsPerSequence#908821, binId#908822]
Arguments: 1
(185) Exchange
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: hashpartitioning(clusterId#906686L, 25), ENSURE_REQUIREMENTS, [plan_id=355649]
(186) Sort
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: [clusterId#906686L ASC NULLS FIRST], false, 0
(187) Window
Input [22]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689]
Arguments: [count(1) windowspecdefinition(clusterId#906686L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#908701L, max(sequenceId#906689) windowspecdefinition(clusterId#906686L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#908702], [clusterId#906686L]
(188) Project
Output [23]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689, (cast(_we0#908701L as double) / cast((_we1#908702 + 1) as double)) AS avgItemsPerSequence#908698]
Input [24]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689, _we0#908701L, _we1#908702]
(189) DeserializeToObject
Input [23]: [supplierGroup#906009, supplier#906010, plant#906011, deliveryDateTime#906012, subrange#906013, supplyingPlant#906014, productGroup#906015, product#906062, orderDateTime#906063, availabilityDateTime#906064, nextAvailabilityDateTime#906065, mrpController#906066, sourceOfSupplyUuid#906067, purchasingOrg#906068, purchasingGroup#906069, isFallbackOrderOnly#906070, orderProposalId#906097L, orderProposalHorizonGroupingId#906098L, splitIndicator#906125L, previousOrderProposal#906126L, clusterId#906686L, sequenceId#906689, avgItemsPerSequence#908698]
Arguments: createexternalrow(invoke(supplierGroup#906009.toString()), invoke(supplier#906010.toString()), invoke(plant#906011.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#906012)), invoke(subrange#906013.toString()), invoke(supplyingPlant#906014.toString()), invoke(productGroup#906015.toString()), invoke(product#906062.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#906063)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#906064)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#906065)), invoke(mrpController#906066.toString()), invoke(sourceOfSupplyUuid#906067.toString()), invoke(purchasingOrg#906068.toString()), invoke(purchasingGroup#906069.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#906070)), static_invoke(java.lang.Long.valueOf(orderProposalId#906097L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#906098L)), static_invoke(java.lang.Long.valueOf(splitIndicator#906125L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#906126L)), static_invoke(java.lang.Long.valueOf(clusterId#906686L)), static_invoke(java.lang.Integer.valueOf(sequenceId#906689)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#908698)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#908749: org.apache.spark.sql.Row
(190) MapPartitions
Input [1]: [obj#908749]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@4d8330dd, obj#908774: org.apache.spark.sql.Row
(191) SerializeFromObject
Input [1]: [obj#908774]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#908799, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#908800, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#908801, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#908802, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#908803, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#908804, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#908805, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#908806, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#908807, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#908808, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#908809, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#908810, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#908811, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#908812, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#908813, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#908814, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#908815L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#908816L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#908817L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#908818L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#908819L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#908820, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#908821, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#908822]
(192) AdaptiveSparkPlan
Output [24]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, avgItemsPerSequence#908821, binId#908822]
Arguments: isFinalPlan=true
(193) TableCacheQueryStage
Output [23]: [availabilityDateTime#908808, binId#908822, clusterId#908819L, deliveryDateTime#908802, isFallbackOrderOnly#908814, mrpController#908810, nextAvailabilityDateTime#908809, orderDateTime#908807, orderProposalHorizonGroupingId#908816L, orderProposalId#908815L, plant#908801, previousOrderProposal#908818L, product#908806, productGroup#908805, purchasingGroup#908813, purchasingOrg#908812, sequenceId#908820, sourceOfSupplyUuid#908811, splitIndicator#908817L, subrange#908803, supplier#908800, supplierGroup#908799, supplyingPlant#908804]
Arguments: 0
(194) Project [codegen id : 1]
Output [24]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, concat(0, _, cast(binId#908822 as string), _, 10000002110) AS shardId#909273, monotonically_increasing_id() AS worklistShardItemId#909274L]
Input [23]: [availabilityDateTime#908808, binId#908822, clusterId#908819L, deliveryDateTime#908802, isFallbackOrderOnly#908814, mrpController#908810, nextAvailabilityDateTime#908809, orderDateTime#908807, orderProposalHorizonGroupingId#908816L, orderProposalId#908815L, plant#908801, previousOrderProposal#908818L, product#908806, productGroup#908805, purchasingGroup#908813, purchasingOrg#908812, sequenceId#908820, sourceOfSupplyUuid#908811, splitIndicator#908817L, subrange#908803, supplier#908800, supplierGroup#908799, supplyingPlant#908804]
(195) Project [codegen id : 1]
Output [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, null AS orderProposalItemGroupId#909275, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#909276]
Input [24]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L]
(196) ResultQueryStage
Output [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: 1
(197) Project
Output [24]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, concat(0, _, cast(binId#908822 as string), _, 10000002110) AS shardId#909273, monotonically_increasing_id() AS worklistShardItemId#909274L]
Input [23]: [availabilityDateTime#908808, binId#908822, clusterId#908819L, deliveryDateTime#908802, isFallbackOrderOnly#908814, mrpController#908810, nextAvailabilityDateTime#908809, orderDateTime#908807, orderProposalHorizonGroupingId#908816L, orderProposalId#908815L, plant#908801, previousOrderProposal#908818L, product#908806, productGroup#908805, purchasingGroup#908813, purchasingOrg#908812, sequenceId#908820, sourceOfSupplyUuid#908811, splitIndicator#908817L, subrange#908803, supplier#908800, supplierGroup#908799, supplyingPlant#908804]
(198) Project
Output [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, null AS orderProposalItemGroupId#909275, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#909276]
Input [24]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L]
(199) AdaptiveSparkPlan
Output [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: isFinalPlan=true
(200) TableCacheQueryStage
Output [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: 0
(201) Exchange
Input [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=355806]
(202) ShuffleQueryStage
Output [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: 1
(203) Sort [codegen id : 1]
Input [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: [shardId#909273 ASC NULLS FIRST], false, 0
(204) WriteFiles
Input [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
(205) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002110, false, [shardId#909273], Parquet, [__partition_columns=["shardId"], path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002110], Overwrite, [supplierGroup, supplier, plant, deliveryDateTime, subrange, supplyingPlant, productGroup, product, orderDateTime, availabilityDateTime, nextAvailabilityDateTime, mrpController, sourceOfSupplyUuid, purchasingOrg, purchasingGroup, isFallbackOrderOnly, orderProposalId, orderProposalHorizonGroupingId, splitIndicator, previousOrderProposal, clusterId, sequenceId, shardId, worklistShardItemId, orderProposalItemGroupId, ... 1 more fields]
(206) ResultQueryStage
Output: []
Arguments: 2
(207) Exchange
Input [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=355785]
(208) Sort
Input [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
Arguments: [shardId#909273 ASC NULLS FIRST], false, 0
(209) WriteFiles
Input [26]: [supplierGroup#908799, supplier#908800, plant#908801, deliveryDateTime#908802, subrange#908803, supplyingPlant#908804, productGroup#908805, product#908806, orderDateTime#908807, availabilityDateTime#908808, nextAvailabilityDateTime#908809, mrpController#908810, sourceOfSupplyUuid#908811, purchasingOrg#908812, purchasingGroup#908813, isFallbackOrderOnly#908814, orderProposalId#908815L, orderProposalHorizonGroupingId#908816L, splitIndicator#908817L, previousOrderProposal#908818L, clusterId#908819L, sequenceId#908820, shardId#909273, worklistShardItemId#909274L, orderProposalItemGroupId#909275, orderProposalItemId#909276]
(210) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002110, false, [shardId#909273], Parquet, [__partition_columns=["shardId"], path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002110], Overwrite, [supplierGroup, supplier, plant, deliveryDateTime, subrange, supplyingPlant, productGroup, product, orderDateTime, availabilityDateTime, nextAvailabilityDateTime, mrpController, sourceOfSupplyUuid, purchasingOrg, purchasingGroup, isFallbackOrderOnly, orderProposalId, orderProposalHorizonGroupingId, splitIndicator, previousOrderProposal, clusterId, sequenceId, shardId, worklistShardItemId, orderProposalItemGroupId, ... 1 more fields]
(211) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true
| Name | Value |
|---|---|
| spark.activity.hdlfsEnabled | true |
| spark.activity.isolateSession | true |
| spark.sql.parquet.fieldId.read.enabled | true |
| spark.sql.parquet.fieldId.write.enabled | true |
| temporal.activity.id | 5f814697-dfbb-368a-80a8-cd3d5f52c0b6 |
| temporal.activity.type | CreateOrderProposalShards |