== Physical Plan ==
AdaptiveSparkPlan (211)
+- == Final Plan ==
ResultQueryStage (206), Statistics(sizeInBytes=8.0 EiB)
+- Execute InsertIntoHadoopFsRelationCommand (205)
+- WriteFiles (204)
+- * Sort (203)
+- ShuffleQueryStage (202), Statistics(sizeInBytes=8.4 KiB, rowCount=18)
+- Exchange (201)
+- TableCacheQueryStage (200), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=6.5 KiB, rowCount=18)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Execute InsertIntoHadoopFsRelationCommand (210)
+- WriteFiles (209)
+- Sort (208)
+- Exchange (207)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=6.5 KiB, rowCount=18)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=7.5 KiB, rowCount=18)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=6.3 KiB, rowCount=18)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=6.9 KiB, rowCount=18)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=6.5 KiB, rowCount=12)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=4.0 KiB, rowCount=12)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1024.5 KiB, rowCount=12)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=1504.0 B, rowCount=12)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=1408.0 B, rowCount=12)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=1184.0 B, rowCount=12)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=2016.0 B, rowCount=18)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=6.1 KiB, rowCount=12)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=6.3 KiB, rowCount=12)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=12)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=3.0 KiB, rowCount=12)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=2.1 KiB, rowCount=12)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
(1) InMemoryTableScan
Output [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, ... 1 more fields]
(2) InMemoryRelation
Arguments: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, ... 1 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [23]: [availabilityDateTime#821074, binId#821088, clusterId#821085L, deliveryDateTime#821068, isFallbackOrderOnly#821080, mrpController#821076, nextAvailabilityDateTime#821075, orderDateTime#821073, orderProposalHorizonGroupingId#821082L, orderProposalId#821081L, plant#821067, previousOrderProposal#821084L, product#821072, productGroup#821071, purchasingGroup#821079, purchasingOrg#821078, sequenceId#821086, sourceOfSupplyUuid#821077, splitIndicator#821083L, subrange#821069, supplier#821066, supplierGroup#821065, supplyingPlant#821070]
Arguments: [availabilityDateTime#821074, binId#821088, clusterId#821085L, deliveryDateTime#821068, isFallbackOrderOnly#821080, mrpController#821076, nextAvailabilityDateTime#821075, orderDateTime#821073, orderProposalHorizonGroupingId#821082L, orderProposalId#821081L, plant#821067, previousOrderProposal#821084L, product#821072, productGroup#821071, purchasingGroup#821079, purchasingOrg#821078, sequenceId#821086, sourceOfSupplyUuid#821077, splitIndicator#821083L, subrange#821069, supplier#821066, supplierGroup#821065, supplyingPlant#821070]
(4) InMemoryRelation
Arguments: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, avgItemsPerSequence#821087, binId#821088], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
(6) InMemoryRelation
Arguments: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955], StorageLevel(disk, memory, 2 replicas)
(7) InMemoryTableScan
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
(8) InMemoryRelation
Arguments: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955], StorageLevel(disk, memory, 2 replicas)
(9) Scan parquet
Output [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002109]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(10) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
(11) Filter [codegen id : 1]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Condition : ((size(productOrderSchedule#818282, true) > 0) AND isnotnull(productOrderSchedule#818282))
(12) Exchange
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=321888]
(13) ShuffleQueryStage
Output [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Arguments: 0
(14) Project [codegen id : 5]
Output [9]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, CASE WHEN isnotnull(supplyingPlant#818280) THEN productGroup#818281 ELSE subrange#818279 END AS effectiveSubrange#818302]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
(15) Exchange
Input [9]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: hashpartitioning(coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278), 25), ENSURE_REQUIREMENTS, [plan_id=322161]
(16) ShuffleQueryStage
Output [9]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: 5
(17) AQEShuffleRead
Input [9]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: local
(18) Scan parquet
Output [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002109/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(19) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
(20) Exchange
Input [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=321904]
(21) ShuffleQueryStage
Output [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Arguments: 1
(22) Scan parquet
Output [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>,orderSplitCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,multiplesOrderQuantity:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(23) ColumnarToRow [codegen id : 3]
Input [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
(24) Filter [codegen id : 3]
Input [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Condition : isnotnull(orderGroupingProfile#818294)
(25) Exchange
Input [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=321917]
(26) ShuffleQueryStage
Output [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Arguments: 2
(27) BroadcastExchange
Input [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=321925]
(28) BroadcastQueryStage
Output [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Arguments: 7
(29) BroadcastHashJoin [codegen id : 7]
Left keys [1]: [orderGroupingProfile#818287]
Right keys [1]: [orderGroupingProfile#818294]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, subrange#818284 AS effectiveSubrange#818303]
Input [10]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
(31) Exchange
Input [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
Arguments: hashpartitioning(coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286), 25), ENSURE_REQUIREMENTS, [plan_id=322617]
(32) ShuffleQueryStage
Output [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
Arguments: 8
(33) AQEShuffleRead
Input [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
Arguments: local
(34) BroadcastExchange
Input [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[8, string, true], ), isnull(input[8, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=322695]
(35) BroadcastQueryStage
Output [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
Arguments: 9
(36) BroadcastHashJoin [codegen id : 8]
Left keys [10]: [coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278)]
Right keys [10]: [coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286)]
Join type: LeftOuter
Join condition: None
(37) Project [codegen id : 8]
Output [14]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, CASE WHEN isnull(orderGroupCriteria#818296) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#818296 END AS orderGroupCriteria#818315, CASE WHEN isnull(orderSplitCriteria#818297) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#818297 END AS orderSplitCriteria#818325, orderGroupingProfile#818287, coalesce(supplierGroup#818275, supplier#818276) AS supplierOrGroup#818304, coalesce(locationGroup#818289, plant#818277) AS locationOrGroup#818305]
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
(38) Project [codegen id : 8]
Output [26]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315.supplierSubrange AS _extract_supplierSubrange#819105, orderGroupCriteria#818315.mrpController AS _extract_mrpController#819106, orderGroupCriteria#818315.purchasingOrg AS _extract_purchasingOrg#819107, orderGroupCriteria#818315.orderDate AS _extract_orderDate#819108, orderGroupCriteria#818315.deliveryDate AS _extract_deliveryDate#819109, orderGroupCriteria#818315.supplier AS _extract_supplier#819110, orderGroupCriteria#818315.purchasingGroup AS _extract_purchasingGroup#819111, orderSplitCriteria#818325.supplierSubrange AS _extract_supplierSubrange#819098, orderSplitCriteria#818325.mrpController AS _extract_mrpController#819099, orderSplitCriteria#818325.orderDate AS _extract_orderDate#819100, orderSplitCriteria#818325.supplier AS _extract_supplier#819101, orderSplitCriteria#818325.deliveryDate AS _extract_deliveryDate#819102, orderSplitCriteria#818325.purchasingOrg AS _extract_purchasingOrg#819103, orderSplitCriteria#818325.purchasingGroup AS _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Input [14]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315, orderSplitCriteria#818325, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
(39) Generate [codegen id : 8]
Input [26]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, _extract_supplierSubrange#819105, _extract_mrpController#819106, _extract_purchasingOrg#819107, _extract_orderDate#819108, _extract_deliveryDate#819109, _extract_supplier#819110, _extract_purchasingGroup#819111, _extract_supplierSubrange#819098, _extract_mrpController#819099, _extract_orderDate#819100, _extract_supplier#819101, _extract_deliveryDate#819102, _extract_purchasingOrg#819103, _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Arguments: explode(productOrderSchedule#818282), [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, effectiveSubrange#818302, _extract_supplierSubrange#819105, _extract_mrpController#819106, _extract_purchasingOrg#819107, _extract_orderDate#819108, _extract_deliveryDate#819109, _extract_supplier#819110, _extract_purchasingGroup#819111, _extract_supplierSubrange#819098, _extract_mrpController#819099, _extract_orderDate#819100, _extract_supplier#819101, _extract_deliveryDate#819102, _extract_purchasingOrg#819103, _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305], false, [productOrderScheduleExploded#818327]
(40) Project [codegen id : 8]
Output [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderScheduleExploded#818327.product AS product#818328, productOrderScheduleExploded#818327.orderDateTime AS orderDateTime#818329, productOrderScheduleExploded#818327.availabilityDateTime AS availabilityDateTime#818330, productOrderScheduleExploded#818327.nextAvailabilityDateTime AS nextAvailabilityDateTime#818331, productOrderScheduleExploded#818327.mrpController AS mrpController#818332, productOrderScheduleExploded#818327.sourceOfSupplyUuid AS sourceOfSupplyUuid#818333, productOrderScheduleExploded#818327.purchasingOrg AS purchasingOrg#818334, productOrderScheduleExploded#818327.purchasingGroup AS purchasingGroup#818335, productOrderScheduleExploded#818327.isFallbackOrderOnly AS isFallbackOrderOnly#818336, xxhash64(CASE WHEN (_extract_supplierSubrange#819105 <=> true) THEN effectiveSubrange#818302 END, orderGroupingProfile#818287, CASE WHEN (_extract_mrpController#819106 <=> true) THEN productOrderScheduleExploded#818327.mrpController END, CASE WHEN (_extract_purchasingOrg#819107 <=> true) THEN productOrderScheduleExploded#818327.purchasingOrg END, CASE WHEN (_extract_orderDate#819108 <=> true) THEN productOrderScheduleExploded#818327.orderDateTime END, CASE WHEN (_extract_deliveryDate#819109 <=> true) THEN deliveryDateTime#818278 END, CASE WHEN (_extract_supplier#819110 <=> true) THEN supplierOrGroup#818304 END, locationOrGroup#818305, CASE WHEN (_extract_purchasingGroup#819111 <=> true) THEN productOrderScheduleExploded#818327.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#818302) AND (_extract_supplierSubrange#819105 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#818287) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.mrpController) AND (_extract_mrpController#819106 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingOrg) AND (_extract_purchasingOrg#819107 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.orderDateTime) AND (_extract_orderDate#819108 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#818278) AND (_extract_deliveryDate#819109 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#818304) AND (_extract_supplier#819110 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#818305) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingGroup) AND (_extract_purchasingGroup#819111 <=> true)) THEN 256 ELSE 0 END), 10000002109, 42) AS orderProposalId#818363L, xxhash64(CASE WHEN (_extract_supplierSubrange#819098 <=> true) THEN effectiveSubrange#818302 END, orderGroupingProfile#818287, CASE WHEN (_extract_mrpController#819099 <=> true) THEN productOrderScheduleExploded#818327.mrpController END, CASE WHEN (_extract_orderDate#819100 <=> true) THEN productOrderScheduleExploded#818327.orderDateTime END, CASE WHEN (_extract_supplier#819101 <=> true) THEN supplier#818276 END, CASE WHEN (_extract_deliveryDate#819102 <=> true) THEN deliveryDateTime#818278 END, CASE WHEN (_extract_purchasingOrg#819103 <=> true) THEN productOrderScheduleExploded#818327.purchasingOrg END, plant#818277, CASE WHEN (_extract_purchasingGroup#819104 <=> true) THEN productOrderScheduleExploded#818327.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#818302) AND (_extract_supplierSubrange#819098 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#818287) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.mrpController) AND (_extract_mrpController#819099 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.orderDateTime) AND (_extract_orderDate#819100 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#818276) AND (_extract_supplier#819101 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#818278) AND (_extract_deliveryDate#819102 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingOrg) AND (_extract_purchasingOrg#819103 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#818277) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingGroup) AND (_extract_purchasingGroup#819104 <=> true)) THEN 256 ELSE 0 END), 10000002109, 42) AS splitIndicator#818391L]
Input [26]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, effectiveSubrange#818302, _extract_supplierSubrange#819105, _extract_mrpController#819106, _extract_purchasingOrg#819107, _extract_orderDate#819108, _extract_deliveryDate#819109, _extract_supplier#819110, _extract_purchasingGroup#819111, _extract_supplierSubrange#819098, _extract_mrpController#819099, _extract_orderDate#819100, _extract_supplier#819101, _extract_deliveryDate#819102, _extract_purchasingOrg#819103, _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305, productOrderScheduleExploded#818327]
(41) Exchange
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L]
Arguments: hashpartitioning(product#818328, plant#818277, 25), ENSURE_REQUIREMENTS, [plan_id=322776]
(42) ShuffleQueryStage
Output [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L]
Arguments: 10
(43) Sort [codegen id : 9]
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L]
Arguments: [product#818328 ASC NULLS FIRST, plant#818277 ASC NULLS FIRST, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST], false, 0
(44) Window
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L]
Arguments: [lag(orderProposalId#818363L, -1, null) windowspecdefinition(product#818328, plant#818277, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#818392L], [product#818328, plant#818277], [availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST]
(45) InMemoryTableScan
Output [4]: [clusterId#818450L, orderProposalId#818445L, plant#818446, previousOrderProposals#818447]
Arguments: [clusterId#818450L, orderProposalId#818445L, plant#818446, previousOrderProposals#818447]
(46) InMemoryRelation
Arguments: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, nodeId#818448L, dependentOnNodeIds#818449, clusterId#818450L, unresolvedDependencies#818451], StorageLevel(disk, memory, 2 replicas)
(47) Scan parquet
Output [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002109]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(48) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
(49) Filter [codegen id : 1]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Condition : ((size(productOrderSchedule#818282, true) > 0) AND isnotnull(productOrderSchedule#818282))
(50) Exchange
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=320621]
(51) ShuffleQueryStage
Output [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Arguments: 0
(52) Project [codegen id : 4]
Output [6]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, CASE WHEN isnotnull(supplyingPlant#818280) THEN productGroup#818281 ELSE subrange#818279 END AS effectiveSubrange#818302]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
(53) Exchange
Input [6]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: hashpartitioning(coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278), 25), ENSURE_REQUIREMENTS, [plan_id=320892]
(54) ShuffleQueryStage
Output [6]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: 3
(55) AQEShuffleRead
Input [6]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: local
(56) Scan parquet
Output [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002109/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(57) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
(58) Exchange
Input [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=320637]
(59) ShuffleQueryStage
Output [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Arguments: 1
(60) Scan parquet
Output [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(61) ColumnarToRow [codegen id : 3]
Input [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
(62) Filter [codegen id : 3]
Input [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Condition : isnotnull(orderGroupingProfile#818294)
(63) Exchange
Input [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=320650]
(64) ShuffleQueryStage
Output [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Arguments: 2
(65) BroadcastExchange
Input [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=320658]
(66) BroadcastQueryStage
Output [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Arguments: 4
(67) BroadcastHashJoin [codegen id : 5]
Left keys [1]: [orderGroupingProfile#818287]
Right keys [1]: [orderGroupingProfile#818294]
Join type: LeftOuter
Join condition: None
(68) Project [codegen id : 5]
Output [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, subrange#818284 AS effectiveSubrange#818303]
Input [9]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupingProfile#818294, orderGroupCriteria#818296]
(69) Exchange
Input [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
Arguments: hashpartitioning(coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286), 25), ENSURE_REQUIREMENTS, [plan_id=321240]
(70) ShuffleQueryStage
Output [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
Arguments: 5
(71) AQEShuffleRead
Input [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
Arguments: local
(72) BroadcastExchange
Input [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[7, string, true], ), isnull(input[7, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=321364]
(73) BroadcastQueryStage
Output [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
Arguments: 6
(74) BroadcastHashJoin [codegen id : 6]
Left keys [10]: [coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278)]
Right keys [10]: [coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286)]
Join type: LeftOuter
Join condition: None
(75) Project [codegen id : 6]
Output [8]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, CASE WHEN isnull(orderGroupCriteria#818296) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#818296 END AS orderGroupCriteria#818315, orderGroupingProfile#818287, coalesce(supplierGroup#818275, supplier#818276) AS supplierOrGroup#818304, coalesce(locationGroup#818289, plant#818277) AS locationOrGroup#818305]
Input [14]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
(76) Project [codegen id : 6]
Output [14]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315.supplierSubrange AS _extract_supplierSubrange#818452, orderGroupCriteria#818315.mrpController AS _extract_mrpController#818453, orderGroupCriteria#818315.purchasingOrg AS _extract_purchasingOrg#818454, orderGroupCriteria#818315.orderDate AS _extract_orderDate#818455, orderGroupCriteria#818315.deliveryDate AS _extract_deliveryDate#818456, orderGroupCriteria#818315.supplier AS _extract_supplier#818457, orderGroupCriteria#818315.purchasingGroup AS _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Input [8]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
(77) Generate [codegen id : 6]
Input [14]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, _extract_supplierSubrange#818452, _extract_mrpController#818453, _extract_purchasingOrg#818454, _extract_orderDate#818455, _extract_deliveryDate#818456, _extract_supplier#818457, _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Arguments: explode(productOrderSchedule#818282), [plant#818277, deliveryDateTime#818278, effectiveSubrange#818302, _extract_supplierSubrange#818452, _extract_mrpController#818453, _extract_purchasingOrg#818454, _extract_orderDate#818455, _extract_deliveryDate#818456, _extract_supplier#818457, _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305], false, [productOrderScheduleExploded#818327]
(78) Project [codegen id : 6]
Output [5]: [plant#818277, productOrderScheduleExploded#818327.product AS product#818328, productOrderScheduleExploded#818327.orderDateTime AS orderDateTime#818329, productOrderScheduleExploded#818327.availabilityDateTime AS availabilityDateTime#818330, xxhash64(CASE WHEN (_extract_supplierSubrange#818452 <=> true) THEN effectiveSubrange#818302 END, orderGroupingProfile#818287, CASE WHEN (_extract_mrpController#818453 <=> true) THEN productOrderScheduleExploded#818327.mrpController END, CASE WHEN (_extract_purchasingOrg#818454 <=> true) THEN productOrderScheduleExploded#818327.purchasingOrg END, CASE WHEN (_extract_orderDate#818455 <=> true) THEN productOrderScheduleExploded#818327.orderDateTime END, CASE WHEN (_extract_deliveryDate#818456 <=> true) THEN deliveryDateTime#818278 END, CASE WHEN (_extract_supplier#818457 <=> true) THEN supplierOrGroup#818304 END, locationOrGroup#818305, CASE WHEN (_extract_purchasingGroup#818458 <=> true) THEN productOrderScheduleExploded#818327.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#818302) AND (_extract_supplierSubrange#818452 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#818287) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.mrpController) AND (_extract_mrpController#818453 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingOrg) AND (_extract_purchasingOrg#818454 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.orderDateTime) AND (_extract_orderDate#818455 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#818278) AND (_extract_deliveryDate#818456 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#818304) AND (_extract_supplier#818457 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#818305) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingGroup) AND (_extract_purchasingGroup#818458 <=> true)) THEN 256 ELSE 0 END), 10000002109, 42) AS orderProposalId#818363L]
Input [14]: [plant#818277, deliveryDateTime#818278, effectiveSubrange#818302, _extract_supplierSubrange#818452, _extract_mrpController#818453, _extract_purchasingOrg#818454, _extract_orderDate#818455, _extract_deliveryDate#818456, _extract_supplier#818457, _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305, productOrderScheduleExploded#818327]
(79) Exchange
Input [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: hashpartitioning(product#818328, plant#818277, 25), ENSURE_REQUIREMENTS, [plan_id=321491]
(80) ShuffleQueryStage
Output [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: 7
(81) AQEShuffleRead
Input [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: coalesced
(82) Sort [codegen id : 7]
Input [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: [product#818328 ASC NULLS FIRST, plant#818277 ASC NULLS FIRST, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST], false, 0
(83) Window
Input [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: [lag(orderProposalId#818363L, -1, null) windowspecdefinition(product#818328, plant#818277, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#818392L], [product#818328, plant#818277], [availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST]
(84) Project [codegen id : 8]
Output [3]: [plant#818277, orderProposalId#818363L, previousOrderProposal#818392L]
Input [6]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L, previousOrderProposal#818392L]
(85) ObjectHashAggregate
Input [3]: [plant#818277, orderProposalId#818363L, previousOrderProposal#818392L]
Keys [1]: [orderProposalId#818363L]
Functions [2]: [partial_min(plant#818277), partial_collect_set(previousOrderProposal#818392L, 0, 0)]
Aggregate Attributes [2]: [min#818716, buf#818717]
Results [3]: [orderProposalId#818363L, min#818718, buf#818719]
(86) Exchange
Input [3]: [orderProposalId#818363L, min#818718, buf#818719]
Arguments: hashpartitioning(orderProposalId#818363L, 25), ENSURE_REQUIREMENTS, [plan_id=321589]
(87) ShuffleQueryStage
Output [3]: [orderProposalId#818363L, min#818718, buf#818719]
Arguments: 8
(88) AQEShuffleRead
Input [3]: [orderProposalId#818363L, min#818718, buf#818719]
Arguments: coalesced
(89) ObjectHashAggregate
Input [3]: [orderProposalId#818363L, min#818718, buf#818719]
Keys [1]: [orderProposalId#818363L]
Functions [2]: [min(plant#818277), collect_set(previousOrderProposal#818392L, 0, 0)]
Aggregate Attributes [2]: [min(plant#818277)#818415, collect_set(previousOrderProposal#818392L, 0, 0)#818416]
Results [4]: [orderProposalId#818363L, min(plant#818277)#818415 AS plant#818393, collect_set(previousOrderProposal#818392L, 0, 0)#818416 AS previousOrderProposals#818394, orderProposalId#818363L AS nodeId#818417L]
(90) Project [codegen id : 9]
Output [5]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L, previousOrderProposals#818394 AS dependentOnNodeIds#818418]
Input [4]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L]
(91) Exchange
Input [5]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L, dependentOnNodeIds#818418]
Arguments: hashpartitioning(plant#818393, 25), REPARTITION_BY_COL, [plan_id=321641]
(92) ShuffleQueryStage
Output [5]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L, dependentOnNodeIds#818418]
Arguments: 9
(93) DeserializeToObject
Input [5]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L, dependentOnNodeIds#818418]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#818363L)), invoke(plant#818393.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#818394, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#818417L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#818418, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#818429: org.apache.spark.sql.Row
(94) MapPartitions
Input [1]: [obj#818429]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@4e5e4601, obj#818437: org.apache.spark.sql.Row
(95) SerializeFromObject [codegen id : 10]
Input [1]: [obj#818437]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#818445L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#818446, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#818447, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#818448L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#818449, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#818450L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#818451]
(96) ResultQueryStage
Output [7]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, nodeId#818448L, dependentOnNodeIds#818449, clusterId#818450L, unresolvedDependencies#818451]
Arguments: 10
(97) Filter
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Condition : ((size(productOrderSchedule#818282, true) > 0) AND isnotnull(productOrderSchedule#818282))
(98) Exchange
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=320499]
(99) Project
Output [6]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, CASE WHEN isnotnull(supplyingPlant#818280) THEN productGroup#818281 ELSE subrange#818279 END AS effectiveSubrange#818302]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
(100) Exchange
Input [6]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: hashpartitioning(coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278), 25), ENSURE_REQUIREMENTS, [plan_id=320523]
(101) Sort
Input [6]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: [coalesce(supplierGroup#818275, ) ASC NULLS FIRST, isnull(supplierGroup#818275) ASC NULLS FIRST, coalesce(supplier#818276, ) ASC NULLS FIRST, isnull(supplier#818276) ASC NULLS FIRST, coalesce(effectiveSubrange#818302, ) ASC NULLS FIRST, isnull(effectiveSubrange#818302) ASC NULLS FIRST, coalesce(plant#818277, ) ASC NULLS FIRST, isnull(plant#818277) ASC NULLS FIRST, coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#818278) ASC NULLS FIRST], false, 0
(102) Exchange
Input [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=320477]
(103) Filter
Input [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Condition : isnotnull(orderGroupingProfile#818294)
(104) Exchange
Input [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=320501]
(105) BroadcastExchange
Input [2]: [orderGroupingProfile#818294, orderGroupCriteria#818296]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=320518]
(106) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#818287]
Right keys [1]: [orderGroupingProfile#818294]
Join type: LeftOuter
Join condition: None
(107) Project
Output [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, subrange#818284 AS effectiveSubrange#818303]
Input [9]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupingProfile#818294, orderGroupCriteria#818296]
(108) Exchange
Input [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
Arguments: hashpartitioning(coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286), 25), ENSURE_REQUIREMENTS, [plan_id=320524]
(109) Sort
Input [8]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
Arguments: [coalesce(supplierGroup#818288, ) ASC NULLS FIRST, isnull(supplierGroup#818288) ASC NULLS FIRST, coalesce(supplier#818283, ) ASC NULLS FIRST, isnull(supplier#818283) ASC NULLS FIRST, coalesce(effectiveSubrange#818303, ) ASC NULLS FIRST, isnull(effectiveSubrange#818303) ASC NULLS FIRST, coalesce(plant#818285, ) ASC NULLS FIRST, isnull(plant#818285) ASC NULLS FIRST, coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#818286) ASC NULLS FIRST], false, 0
(110) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278)]
Right keys [10]: [coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286)]
Join type: LeftOuter
Join condition: None
(111) Project
Output [8]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, CASE WHEN isnull(orderGroupCriteria#818296) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#818296 END AS orderGroupCriteria#818315, orderGroupingProfile#818287, coalesce(supplierGroup#818275, supplier#818276) AS supplierOrGroup#818304, coalesce(locationGroup#818289, plant#818277) AS locationOrGroup#818305]
Input [14]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, effectiveSubrange#818303]
(112) Project
Output [14]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315.supplierSubrange AS _extract_supplierSubrange#818452, orderGroupCriteria#818315.mrpController AS _extract_mrpController#818453, orderGroupCriteria#818315.purchasingOrg AS _extract_purchasingOrg#818454, orderGroupCriteria#818315.orderDate AS _extract_orderDate#818455, orderGroupCriteria#818315.deliveryDate AS _extract_deliveryDate#818456, orderGroupCriteria#818315.supplier AS _extract_supplier#818457, orderGroupCriteria#818315.purchasingGroup AS _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Input [8]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
(113) Generate
Input [14]: [plant#818277, deliveryDateTime#818278, productOrderSchedule#818282, effectiveSubrange#818302, _extract_supplierSubrange#818452, _extract_mrpController#818453, _extract_purchasingOrg#818454, _extract_orderDate#818455, _extract_deliveryDate#818456, _extract_supplier#818457, _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Arguments: explode(productOrderSchedule#818282), [plant#818277, deliveryDateTime#818278, effectiveSubrange#818302, _extract_supplierSubrange#818452, _extract_mrpController#818453, _extract_purchasingOrg#818454, _extract_orderDate#818455, _extract_deliveryDate#818456, _extract_supplier#818457, _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305], false, [productOrderScheduleExploded#818327]
(114) Project
Output [5]: [plant#818277, productOrderScheduleExploded#818327.product AS product#818328, productOrderScheduleExploded#818327.orderDateTime AS orderDateTime#818329, productOrderScheduleExploded#818327.availabilityDateTime AS availabilityDateTime#818330, xxhash64(CASE WHEN (_extract_supplierSubrange#818452 <=> true) THEN effectiveSubrange#818302 END, orderGroupingProfile#818287, CASE WHEN (_extract_mrpController#818453 <=> true) THEN productOrderScheduleExploded#818327.mrpController END, CASE WHEN (_extract_purchasingOrg#818454 <=> true) THEN productOrderScheduleExploded#818327.purchasingOrg END, CASE WHEN (_extract_orderDate#818455 <=> true) THEN productOrderScheduleExploded#818327.orderDateTime END, CASE WHEN (_extract_deliveryDate#818456 <=> true) THEN deliveryDateTime#818278 END, CASE WHEN (_extract_supplier#818457 <=> true) THEN supplierOrGroup#818304 END, locationOrGroup#818305, CASE WHEN (_extract_purchasingGroup#818458 <=> true) THEN productOrderScheduleExploded#818327.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#818302) AND (_extract_supplierSubrange#818452 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#818287) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.mrpController) AND (_extract_mrpController#818453 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingOrg) AND (_extract_purchasingOrg#818454 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.orderDateTime) AND (_extract_orderDate#818455 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#818278) AND (_extract_deliveryDate#818456 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#818304) AND (_extract_supplier#818457 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#818305) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingGroup) AND (_extract_purchasingGroup#818458 <=> true)) THEN 256 ELSE 0 END), 10000002109, 42) AS orderProposalId#818363L]
Input [14]: [plant#818277, deliveryDateTime#818278, effectiveSubrange#818302, _extract_supplierSubrange#818452, _extract_mrpController#818453, _extract_purchasingOrg#818454, _extract_orderDate#818455, _extract_deliveryDate#818456, _extract_supplier#818457, _extract_purchasingGroup#818458, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305, productOrderScheduleExploded#818327]
(115) Exchange
Input [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: hashpartitioning(product#818328, plant#818277, 25), ENSURE_REQUIREMENTS, [plan_id=320533]
(116) Sort
Input [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: [product#818328 ASC NULLS FIRST, plant#818277 ASC NULLS FIRST, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST], false, 0
(117) Window
Input [5]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L]
Arguments: [lag(orderProposalId#818363L, -1, null) windowspecdefinition(product#818328, plant#818277, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#818392L], [product#818328, plant#818277], [availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST]
(118) Project
Output [3]: [plant#818277, orderProposalId#818363L, previousOrderProposal#818392L]
Input [6]: [plant#818277, product#818328, orderDateTime#818329, availabilityDateTime#818330, orderProposalId#818363L, previousOrderProposal#818392L]
(119) ObjectHashAggregate
Input [3]: [plant#818277, orderProposalId#818363L, previousOrderProposal#818392L]
Keys [1]: [orderProposalId#818363L]
Functions [2]: [partial_min(plant#818277), partial_collect_set(previousOrderProposal#818392L, 0, 0)]
Aggregate Attributes [2]: [min#818716, buf#818717]
Results [3]: [orderProposalId#818363L, min#818718, buf#818719]
(120) Exchange
Input [3]: [orderProposalId#818363L, min#818718, buf#818719]
Arguments: hashpartitioning(orderProposalId#818363L, 25), ENSURE_REQUIREMENTS, [plan_id=320539]
(121) ObjectHashAggregate
Input [3]: [orderProposalId#818363L, min#818718, buf#818719]
Keys [1]: [orderProposalId#818363L]
Functions [2]: [min(plant#818277), collect_set(previousOrderProposal#818392L, 0, 0)]
Aggregate Attributes [2]: [min(plant#818277)#818415, collect_set(previousOrderProposal#818392L, 0, 0)#818416]
Results [4]: [orderProposalId#818363L, min(plant#818277)#818415 AS plant#818393, collect_set(previousOrderProposal#818392L, 0, 0)#818416 AS previousOrderProposals#818394, orderProposalId#818363L AS nodeId#818417L]
(122) Project
Output [5]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L, previousOrderProposals#818394 AS dependentOnNodeIds#818418]
Input [4]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L]
(123) Exchange
Input [5]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L, dependentOnNodeIds#818418]
Arguments: hashpartitioning(plant#818393, 25), REPARTITION_BY_COL, [plan_id=320542]
(124) DeserializeToObject
Input [5]: [orderProposalId#818363L, plant#818393, previousOrderProposals#818394, nodeId#818417L, dependentOnNodeIds#818418]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#818363L)), invoke(plant#818393.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#818394, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#818417L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#818418, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#818429: org.apache.spark.sql.Row
(125) MapPartitions
Input [1]: [obj#818429]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@4e5e4601, obj#818437: org.apache.spark.sql.Row
(126) SerializeFromObject
Input [1]: [obj#818437]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#818445L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#818446, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#818447, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#818448L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#818449, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#818450L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#818451]
(127) AdaptiveSparkPlan
Output [7]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, nodeId#818448L, dependentOnNodeIds#818449, clusterId#818450L, unresolvedDependencies#818451]
Arguments: isFinalPlan=true
(128) TableCacheQueryStage
Output [4]: [clusterId#818450L, orderProposalId#818445L, plant#818446, previousOrderProposals#818447]
Arguments: 3
(129) Project [codegen id : 4]
Output [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, orderProposalId#818445L AS nodeId#818919L, previousOrderProposals#818447 AS dependentOnNodeIds#818920]
Input [4]: [clusterId#818450L, orderProposalId#818445L, plant#818446, previousOrderProposals#818447]
(130) Exchange
Input [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, nodeId#818919L, dependentOnNodeIds#818920]
Arguments: hashpartitioning(clusterId#818450L, 25), REPARTITION_BY_COL, [plan_id=322074]
(131) ShuffleQueryStage
Output [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, nodeId#818919L, dependentOnNodeIds#818920]
Arguments: 4
(132) AQEShuffleRead
Input [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, nodeId#818919L, dependentOnNodeIds#818920]
Arguments: coalesced
(133) DeserializeToObject
Input [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, nodeId#818919L, dependentOnNodeIds#818920]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#818445L)), invoke(plant#818446.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#818447, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#818450L)), static_invoke(java.lang.Long.valueOf(nodeId#818919L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#818920, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#818933: org.apache.spark.sql.Row
(134) MapPartitions
Input [1]: [obj#818933]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@6b8e628a, obj#818941: org.apache.spark.sql.Row
(135) SerializeFromObject [codegen id : 6]
Input [1]: [obj#818941]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#818949L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#818952L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#818955]
(136) BroadcastExchange
Input [3]: [orderProposalId#818949L, clusterId#818952L, sequenceId#818955]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=322343]
(137) BroadcastQueryStage
Output [3]: [orderProposalId#818949L, clusterId#818952L, sequenceId#818955]
Arguments: 6
(138) BroadcastHashJoin [codegen id : 10]
Left keys [1]: [orderProposalId#818363L]
Right keys [1]: [orderProposalId#818949L]
Join type: LeftOuter
Join condition: None
(139) Project [codegen id : 10]
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, 0 AS orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L, previousOrderProposal#818392L, orderProposalId#818949L, clusterId#818952L, sequenceId#818955]
(140) ResultQueryStage
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: 11
(141) Filter
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Condition : ((size(productOrderSchedule#818282, true) > 0) AND isnotnull(productOrderSchedule#818282))
(142) Exchange
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=321788]
(143) Project
Output [9]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, CASE WHEN isnotnull(supplyingPlant#818280) THEN productGroup#818281 ELSE subrange#818279 END AS effectiveSubrange#818302]
Input [8]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282]
(144) Exchange
Input [9]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: hashpartitioning(coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278), 25), ENSURE_REQUIREMENTS, [plan_id=321806]
(145) Sort
Input [9]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302]
Arguments: [coalesce(supplierGroup#818275, ) ASC NULLS FIRST, isnull(supplierGroup#818275) ASC NULLS FIRST, coalesce(supplier#818276, ) ASC NULLS FIRST, isnull(supplier#818276) ASC NULLS FIRST, coalesce(effectiveSubrange#818302, ) ASC NULLS FIRST, isnull(effectiveSubrange#818302) ASC NULLS FIRST, coalesce(plant#818277, ) ASC NULLS FIRST, isnull(plant#818277) ASC NULLS FIRST, coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#818278) ASC NULLS FIRST], false, 0
(146) Exchange
Input [7]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=321766]
(147) Filter
Input [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Condition : isnotnull(orderGroupingProfile#818294)
(148) Exchange
Input [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=321790]
(149) BroadcastExchange
Input [3]: [orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=321801]
(150) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#818287]
Right keys [1]: [orderGroupingProfile#818294]
Join type: LeftOuter
Join condition: None
(151) Project
Output [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, subrange#818284 AS effectiveSubrange#818303]
Input [10]: [supplier#818283, subrange#818284, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupingProfile#818294, orderGroupCriteria#818296, orderSplitCriteria#818297]
(152) Exchange
Input [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
Arguments: hashpartitioning(coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286), 25), ENSURE_REQUIREMENTS, [plan_id=321807]
(153) Sort
Input [9]: [supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
Arguments: [coalesce(supplierGroup#818288, ) ASC NULLS FIRST, isnull(supplierGroup#818288) ASC NULLS FIRST, coalesce(supplier#818283, ) ASC NULLS FIRST, isnull(supplier#818283) ASC NULLS FIRST, coalesce(effectiveSubrange#818303, ) ASC NULLS FIRST, isnull(effectiveSubrange#818303) ASC NULLS FIRST, coalesce(plant#818285, ) ASC NULLS FIRST, isnull(plant#818285) ASC NULLS FIRST, coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#818286) ASC NULLS FIRST], false, 0
(154) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#818275, ), isnull(supplierGroup#818275), coalesce(supplier#818276, ), isnull(supplier#818276), coalesce(effectiveSubrange#818302, ), isnull(effectiveSubrange#818302), coalesce(plant#818277, ), isnull(plant#818277), coalesce(deliveryDateTime#818278, 1970-01-01 00:00:00), isnull(deliveryDateTime#818278)]
Right keys [10]: [coalesce(supplierGroup#818288, ), isnull(supplierGroup#818288), coalesce(supplier#818283, ), isnull(supplier#818283), coalesce(effectiveSubrange#818303, ), isnull(effectiveSubrange#818303), coalesce(plant#818285, ), isnull(plant#818285), coalesce(deliveryDateTime#818286, 1970-01-01 00:00:00), isnull(deliveryDateTime#818286)]
Join type: LeftOuter
Join condition: None
(155) Project
Output [14]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, CASE WHEN isnull(orderGroupCriteria#818296) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#818296 END AS orderGroupCriteria#818315, CASE WHEN isnull(orderSplitCriteria#818297) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#818297 END AS orderSplitCriteria#818325, orderGroupingProfile#818287, coalesce(supplierGroup#818275, supplier#818276) AS supplierOrGroup#818304, coalesce(locationGroup#818289, plant#818277) AS locationOrGroup#818305]
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, supplier#818283, plant#818285, deliverydatetime#818286, ordergroupingprofile#818287, supplierGroup#818288, locationGroup#818289, orderGroupCriteria#818296, orderSplitCriteria#818297, effectiveSubrange#818303]
(156) Project
Output [26]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315.supplierSubrange AS _extract_supplierSubrange#819105, orderGroupCriteria#818315.mrpController AS _extract_mrpController#819106, orderGroupCriteria#818315.purchasingOrg AS _extract_purchasingOrg#819107, orderGroupCriteria#818315.orderDate AS _extract_orderDate#819108, orderGroupCriteria#818315.deliveryDate AS _extract_deliveryDate#819109, orderGroupCriteria#818315.supplier AS _extract_supplier#819110, orderGroupCriteria#818315.purchasingGroup AS _extract_purchasingGroup#819111, orderSplitCriteria#818325.supplierSubrange AS _extract_supplierSubrange#819098, orderSplitCriteria#818325.mrpController AS _extract_mrpController#819099, orderSplitCriteria#818325.orderDate AS _extract_orderDate#819100, orderSplitCriteria#818325.supplier AS _extract_supplier#819101, orderSplitCriteria#818325.deliveryDate AS _extract_deliveryDate#819102, orderSplitCriteria#818325.purchasingOrg AS _extract_purchasingOrg#819103, orderSplitCriteria#818325.purchasingGroup AS _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Input [14]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, orderGroupCriteria#818315, orderSplitCriteria#818325, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
(157) Generate
Input [26]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderSchedule#818282, effectiveSubrange#818302, _extract_supplierSubrange#819105, _extract_mrpController#819106, _extract_purchasingOrg#819107, _extract_orderDate#819108, _extract_deliveryDate#819109, _extract_supplier#819110, _extract_purchasingGroup#819111, _extract_supplierSubrange#819098, _extract_mrpController#819099, _extract_orderDate#819100, _extract_supplier#819101, _extract_deliveryDate#819102, _extract_purchasingOrg#819103, _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305]
Arguments: explode(productOrderSchedule#818282), [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, effectiveSubrange#818302, _extract_supplierSubrange#819105, _extract_mrpController#819106, _extract_purchasingOrg#819107, _extract_orderDate#819108, _extract_deliveryDate#819109, _extract_supplier#819110, _extract_purchasingGroup#819111, _extract_supplierSubrange#819098, _extract_mrpController#819099, _extract_orderDate#819100, _extract_supplier#819101, _extract_deliveryDate#819102, _extract_purchasingOrg#819103, _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305], false, [productOrderScheduleExploded#818327]
(158) Project
Output [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, productOrderScheduleExploded#818327.product AS product#818328, productOrderScheduleExploded#818327.orderDateTime AS orderDateTime#818329, productOrderScheduleExploded#818327.availabilityDateTime AS availabilityDateTime#818330, productOrderScheduleExploded#818327.nextAvailabilityDateTime AS nextAvailabilityDateTime#818331, productOrderScheduleExploded#818327.mrpController AS mrpController#818332, productOrderScheduleExploded#818327.sourceOfSupplyUuid AS sourceOfSupplyUuid#818333, productOrderScheduleExploded#818327.purchasingOrg AS purchasingOrg#818334, productOrderScheduleExploded#818327.purchasingGroup AS purchasingGroup#818335, productOrderScheduleExploded#818327.isFallbackOrderOnly AS isFallbackOrderOnly#818336, xxhash64(CASE WHEN (_extract_supplierSubrange#819105 <=> true) THEN effectiveSubrange#818302 END, orderGroupingProfile#818287, CASE WHEN (_extract_mrpController#819106 <=> true) THEN productOrderScheduleExploded#818327.mrpController END, CASE WHEN (_extract_purchasingOrg#819107 <=> true) THEN productOrderScheduleExploded#818327.purchasingOrg END, CASE WHEN (_extract_orderDate#819108 <=> true) THEN productOrderScheduleExploded#818327.orderDateTime END, CASE WHEN (_extract_deliveryDate#819109 <=> true) THEN deliveryDateTime#818278 END, CASE WHEN (_extract_supplier#819110 <=> true) THEN supplierOrGroup#818304 END, locationOrGroup#818305, CASE WHEN (_extract_purchasingGroup#819111 <=> true) THEN productOrderScheduleExploded#818327.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#818302) AND (_extract_supplierSubrange#819105 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#818287) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.mrpController) AND (_extract_mrpController#819106 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingOrg) AND (_extract_purchasingOrg#819107 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.orderDateTime) AND (_extract_orderDate#819108 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#818278) AND (_extract_deliveryDate#819109 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#818304) AND (_extract_supplier#819110 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#818305) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingGroup) AND (_extract_purchasingGroup#819111 <=> true)) THEN 256 ELSE 0 END), 10000002109, 42) AS orderProposalId#818363L, xxhash64(CASE WHEN (_extract_supplierSubrange#819098 <=> true) THEN effectiveSubrange#818302 END, orderGroupingProfile#818287, CASE WHEN (_extract_mrpController#819099 <=> true) THEN productOrderScheduleExploded#818327.mrpController END, CASE WHEN (_extract_orderDate#819100 <=> true) THEN productOrderScheduleExploded#818327.orderDateTime END, CASE WHEN (_extract_supplier#819101 <=> true) THEN supplier#818276 END, CASE WHEN (_extract_deliveryDate#819102 <=> true) THEN deliveryDateTime#818278 END, CASE WHEN (_extract_purchasingOrg#819103 <=> true) THEN productOrderScheduleExploded#818327.purchasingOrg END, plant#818277, CASE WHEN (_extract_purchasingGroup#819104 <=> true) THEN productOrderScheduleExploded#818327.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#818302) AND (_extract_supplierSubrange#819098 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#818287) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.mrpController) AND (_extract_mrpController#819099 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.orderDateTime) AND (_extract_orderDate#819100 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#818276) AND (_extract_supplier#819101 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#818278) AND (_extract_deliveryDate#819102 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingOrg) AND (_extract_purchasingOrg#819103 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#818277) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#818327.purchasingGroup) AND (_extract_purchasingGroup#819104 <=> true)) THEN 256 ELSE 0 END), 10000002109, 42) AS splitIndicator#818391L]
Input [26]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, effectiveSubrange#818302, _extract_supplierSubrange#819105, _extract_mrpController#819106, _extract_purchasingOrg#819107, _extract_orderDate#819108, _extract_deliveryDate#819109, _extract_supplier#819110, _extract_purchasingGroup#819111, _extract_supplierSubrange#819098, _extract_mrpController#819099, _extract_orderDate#819100, _extract_supplier#819101, _extract_deliveryDate#819102, _extract_purchasingOrg#819103, _extract_purchasingGroup#819104, orderGroupingProfile#818287, supplierOrGroup#818304, locationOrGroup#818305, productOrderScheduleExploded#818327]
(159) Exchange
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L]
Arguments: hashpartitioning(product#818328, plant#818277, 25), ENSURE_REQUIREMENTS, [plan_id=321816]
(160) Sort
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L]
Arguments: [product#818328 ASC NULLS FIRST, plant#818277 ASC NULLS FIRST, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST], false, 0
(161) Window
Input [18]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L]
Arguments: [lag(orderProposalId#818363L, -1, null) windowspecdefinition(product#818328, plant#818277, availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#818392L], [product#818328, plant#818277], [availabilityDateTime#818330 ASC NULLS FIRST, orderDateTime#818329 ASC NULLS FIRST, orderProposalId#818363L ASC NULLS FIRST]
(162) Project
Output [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, orderProposalId#818445L AS nodeId#818919L, previousOrderProposals#818447 AS dependentOnNodeIds#818920]
Input [4]: [clusterId#818450L, orderProposalId#818445L, plant#818446, previousOrderProposals#818447]
(163) Exchange
Input [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, nodeId#818919L, dependentOnNodeIds#818920]
Arguments: hashpartitioning(clusterId#818450L, 25), REPARTITION_BY_COL, [plan_id=321781]
(164) DeserializeToObject
Input [6]: [orderProposalId#818445L, plant#818446, previousOrderProposals#818447, clusterId#818450L, nodeId#818919L, dependentOnNodeIds#818920]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#818445L)), invoke(plant#818446.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#818447, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#818450L)), static_invoke(java.lang.Long.valueOf(nodeId#818919L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#818920, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#818933: org.apache.spark.sql.Row
(165) MapPartitions
Input [1]: [obj#818933]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@6b8e628a, obj#818941: org.apache.spark.sql.Row
(166) SerializeFromObject
Input [1]: [obj#818941]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#818949L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#818952L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#818955]
(167) BroadcastExchange
Input [3]: [orderProposalId#818949L, clusterId#818952L, sequenceId#818955]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=321820]
(168) BroadcastHashJoin
Left keys [1]: [orderProposalId#818363L]
Right keys [1]: [orderProposalId#818949L]
Join type: LeftOuter
Join condition: None
(169) Project
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, 0 AS orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, splitIndicator#818391L, previousOrderProposal#818392L, orderProposalId#818949L, clusterId#818952L, sequenceId#818955]
(170) AdaptiveSparkPlan
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: isFinalPlan=true
(171) TableCacheQueryStage
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: 0
(172) Exchange
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=323056]
(173) ShuffleQueryStage
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: 1
(174) ResultQueryStage
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: 2
(175) Exchange
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=322974]
(176) AdaptiveSparkPlan
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: isFinalPlan=true
(177) TableCacheQueryStage
Output [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: 0
(178) Sort [codegen id : 1]
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: [clusterId#818952L ASC NULLS FIRST], false, 0
(179) Window
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: [count(1) windowspecdefinition(clusterId#818952L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#820967L, max(sequenceId#818955) windowspecdefinition(clusterId#818952L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#820968], [clusterId#818952L]
(180) Project [codegen id : 2]
Output [23]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955, (cast(_we0#820967L as double) / cast((_we1#820968 + 1) as double)) AS avgItemsPerSequence#820964]
Input [24]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955, _we0#820967L, _we1#820968]
(181) DeserializeToObject
Input [23]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955, avgItemsPerSequence#820964]
Arguments: createexternalrow(invoke(supplierGroup#818275.toString()), invoke(supplier#818276.toString()), invoke(plant#818277.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#818278)), invoke(subrange#818279.toString()), invoke(supplyingPlant#818280.toString()), invoke(productGroup#818281.toString()), invoke(product#818328.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#818329)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#818330)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#818331)), invoke(mrpController#818332.toString()), invoke(sourceOfSupplyUuid#818333.toString()), invoke(purchasingOrg#818334.toString()), invoke(purchasingGroup#818335.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#818336)), static_invoke(java.lang.Long.valueOf(orderProposalId#818363L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#818364L)), static_invoke(java.lang.Long.valueOf(splitIndicator#818391L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#818392L)), static_invoke(java.lang.Long.valueOf(clusterId#818952L)), static_invoke(java.lang.Integer.valueOf(sequenceId#818955)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#820964)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#821015: org.apache.spark.sql.Row
(182) MapPartitions
Input [1]: [obj#821015]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@73fcd05f, obj#821040: org.apache.spark.sql.Row
(183) SerializeFromObject [codegen id : 3]
Input [1]: [obj#821040]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#821065, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#821066, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#821067, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#821068, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#821069, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#821070, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#821071, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#821072, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#821073, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#821074, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#821075, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#821076, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#821077, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#821078, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#821079, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#821080, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#821081L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#821082L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#821083L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#821084L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#821085L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#821086, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#821087, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#821088]
(184) ResultQueryStage
Output [24]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, avgItemsPerSequence#821087, binId#821088]
Arguments: 1
(185) Exchange
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: hashpartitioning(clusterId#818952L, 25), ENSURE_REQUIREMENTS, [plan_id=323000]
(186) Sort
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: [clusterId#818952L ASC NULLS FIRST], false, 0
(187) Window
Input [22]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955]
Arguments: [count(1) windowspecdefinition(clusterId#818952L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#820967L, max(sequenceId#818955) windowspecdefinition(clusterId#818952L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#820968], [clusterId#818952L]
(188) Project
Output [23]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955, (cast(_we0#820967L as double) / cast((_we1#820968 + 1) as double)) AS avgItemsPerSequence#820964]
Input [24]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955, _we0#820967L, _we1#820968]
(189) DeserializeToObject
Input [23]: [supplierGroup#818275, supplier#818276, plant#818277, deliveryDateTime#818278, subrange#818279, supplyingPlant#818280, productGroup#818281, product#818328, orderDateTime#818329, availabilityDateTime#818330, nextAvailabilityDateTime#818331, mrpController#818332, sourceOfSupplyUuid#818333, purchasingOrg#818334, purchasingGroup#818335, isFallbackOrderOnly#818336, orderProposalId#818363L, orderProposalHorizonGroupingId#818364L, splitIndicator#818391L, previousOrderProposal#818392L, clusterId#818952L, sequenceId#818955, avgItemsPerSequence#820964]
Arguments: createexternalrow(invoke(supplierGroup#818275.toString()), invoke(supplier#818276.toString()), invoke(plant#818277.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#818278)), invoke(subrange#818279.toString()), invoke(supplyingPlant#818280.toString()), invoke(productGroup#818281.toString()), invoke(product#818328.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#818329)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#818330)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#818331)), invoke(mrpController#818332.toString()), invoke(sourceOfSupplyUuid#818333.toString()), invoke(purchasingOrg#818334.toString()), invoke(purchasingGroup#818335.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#818336)), static_invoke(java.lang.Long.valueOf(orderProposalId#818363L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#818364L)), static_invoke(java.lang.Long.valueOf(splitIndicator#818391L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#818392L)), static_invoke(java.lang.Long.valueOf(clusterId#818952L)), static_invoke(java.lang.Integer.valueOf(sequenceId#818955)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#820964)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#821015: org.apache.spark.sql.Row
(190) MapPartitions
Input [1]: [obj#821015]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@73fcd05f, obj#821040: org.apache.spark.sql.Row
(191) SerializeFromObject
Input [1]: [obj#821040]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#821065, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#821066, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#821067, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#821068, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#821069, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#821070, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#821071, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#821072, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#821073, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#821074, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#821075, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#821076, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#821077, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#821078, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#821079, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#821080, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#821081L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#821082L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#821083L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#821084L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#821085L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#821086, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#821087, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#821088]
(192) AdaptiveSparkPlan
Output [24]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, avgItemsPerSequence#821087, binId#821088]
Arguments: isFinalPlan=true
(193) TableCacheQueryStage
Output [23]: [availabilityDateTime#821074, binId#821088, clusterId#821085L, deliveryDateTime#821068, isFallbackOrderOnly#821080, mrpController#821076, nextAvailabilityDateTime#821075, orderDateTime#821073, orderProposalHorizonGroupingId#821082L, orderProposalId#821081L, plant#821067, previousOrderProposal#821084L, product#821072, productGroup#821071, purchasingGroup#821079, purchasingOrg#821078, sequenceId#821086, sourceOfSupplyUuid#821077, splitIndicator#821083L, subrange#821069, supplier#821066, supplierGroup#821065, supplyingPlant#821070]
Arguments: 0
(194) Project [codegen id : 1]
Output [24]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, concat(0, _, cast(binId#821088 as string), _, 10000002109) AS shardId#821539, monotonically_increasing_id() AS worklistShardItemId#821540L]
Input [23]: [availabilityDateTime#821074, binId#821088, clusterId#821085L, deliveryDateTime#821068, isFallbackOrderOnly#821080, mrpController#821076, nextAvailabilityDateTime#821075, orderDateTime#821073, orderProposalHorizonGroupingId#821082L, orderProposalId#821081L, plant#821067, previousOrderProposal#821084L, product#821072, productGroup#821071, purchasingGroup#821079, purchasingOrg#821078, sequenceId#821086, sourceOfSupplyUuid#821077, splitIndicator#821083L, subrange#821069, supplier#821066, supplierGroup#821065, supplyingPlant#821070]
(195) Project [codegen id : 1]
Output [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, null AS orderProposalItemGroupId#821541, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#821542]
Input [24]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L]
(196) ResultQueryStage
Output [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: 1
(197) Project
Output [24]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, concat(0, _, cast(binId#821088 as string), _, 10000002109) AS shardId#821539, monotonically_increasing_id() AS worklistShardItemId#821540L]
Input [23]: [availabilityDateTime#821074, binId#821088, clusterId#821085L, deliveryDateTime#821068, isFallbackOrderOnly#821080, mrpController#821076, nextAvailabilityDateTime#821075, orderDateTime#821073, orderProposalHorizonGroupingId#821082L, orderProposalId#821081L, plant#821067, previousOrderProposal#821084L, product#821072, productGroup#821071, purchasingGroup#821079, purchasingOrg#821078, sequenceId#821086, sourceOfSupplyUuid#821077, splitIndicator#821083L, subrange#821069, supplier#821066, supplierGroup#821065, supplyingPlant#821070]
(198) Project
Output [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, null AS orderProposalItemGroupId#821541, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#821542]
Input [24]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L]
(199) AdaptiveSparkPlan
Output [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: isFinalPlan=true
(200) TableCacheQueryStage
Output [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: 0
(201) Exchange
Input [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=323157]
(202) ShuffleQueryStage
Output [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: 1
(203) Sort [codegen id : 1]
Input [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: [shardId#821539 ASC NULLS FIRST], false, 0
(204) WriteFiles
Input [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
(205) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002109, false, [shardId#821539], Parquet, [__partition_columns=["shardId"], path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002109], Overwrite, [supplierGroup, supplier, plant, deliveryDateTime, subrange, supplyingPlant, productGroup, product, orderDateTime, availabilityDateTime, nextAvailabilityDateTime, mrpController, sourceOfSupplyUuid, purchasingOrg, purchasingGroup, isFallbackOrderOnly, orderProposalId, orderProposalHorizonGroupingId, splitIndicator, previousOrderProposal, clusterId, sequenceId, shardId, worklistShardItemId, orderProposalItemGroupId, ... 1 more fields]
(206) ResultQueryStage
Output: []
Arguments: 2
(207) Exchange
Input [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=323136]
(208) Sort
Input [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
Arguments: [shardId#821539 ASC NULLS FIRST], false, 0
(209) WriteFiles
Input [26]: [supplierGroup#821065, supplier#821066, plant#821067, deliveryDateTime#821068, subrange#821069, supplyingPlant#821070, productGroup#821071, product#821072, orderDateTime#821073, availabilityDateTime#821074, nextAvailabilityDateTime#821075, mrpController#821076, sourceOfSupplyUuid#821077, purchasingOrg#821078, purchasingGroup#821079, isFallbackOrderOnly#821080, orderProposalId#821081L, orderProposalHorizonGroupingId#821082L, splitIndicator#821083L, previousOrderProposal#821084L, clusterId#821085L, sequenceId#821086, shardId#821539, worklistShardItemId#821540L, orderProposalItemGroupId#821541, orderProposalItemId#821542]
(210) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002109, false, [shardId#821539], Parquet, [__partition_columns=["shardId"], path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-boundary-snapshot/10000002109], Overwrite, [supplierGroup, supplier, plant, deliveryDateTime, subrange, supplyingPlant, productGroup, product, orderDateTime, availabilityDateTime, nextAvailabilityDateTime, mrpController, sourceOfSupplyUuid, purchasingOrg, purchasingGroup, isFallbackOrderOnly, orderProposalId, orderProposalHorizonGroupingId, splitIndicator, previousOrderProposal, clusterId, sequenceId, shardId, worklistShardItemId, orderProposalItemGroupId, ... 1 more fields]
(211) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true
| Name | Value |
|---|---|
| spark.activity.hdlfsEnabled | true |
| spark.activity.isolateSession | true |
| spark.sql.parquet.fieldId.read.enabled | true |
| spark.sql.parquet.fieldId.write.enabled | true |
| temporal.activity.id | 5a20a6ec-f630-3035-8a8e-5f0dd525540c |
| temporal.activity.type | CreateOrderProposalShards |