== Physical Plan ==
AdaptiveSparkPlan (206)
+- == Final Plan ==
ResultQueryStage (203), Statistics(sizeInBytes=8.0 EiB)
+- * HashAggregate (202)
+- * HashAggregate (201)
+- TableCacheQueryStage (200), Statistics(sizeInBytes=1123.6 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=1047.2 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
HashAggregate (205)
+- HashAggregate (204)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- AdaptiveSparkPlan (199)
+- == Final Plan ==
ResultQueryStage (196)
+- * Project (195)
+- * Project (194)
+- TableCacheQueryStage (193), Statistics(sizeInBytes=1047.2 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (198)
+- Project (197)
+- InMemoryTableScan (3)
+- InMemoryRelation (4)
+- AdaptiveSparkPlan (192)
+- == Final Plan ==
ResultQueryStage (184)
+- * SerializeFromObject (183)
+- MapPartitions (182)
+- DeserializeToObject (181)
+- * Project (180)
+- Window (179)
+- * Sort (178)
+- TableCacheQueryStage (177), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (191)
+- MapPartitions (190)
+- DeserializeToObject (189)
+- Project (188)
+- Window (187)
+- Sort (186)
+- Exchange (185)
+- InMemoryTableScan (5)
+- InMemoryRelation (6)
+- AdaptiveSparkPlan (176)
+- == Final Plan ==
ResultQueryStage (174)
+- ShuffleQueryStage (173), Statistics(sizeInBytes=1207.6 KiB, rowCount=2.94E+3)
+- Exchange (172)
+- TableCacheQueryStage (171), Statistics(sizeInBytes=1012.7 KiB, rowCount=2.94E+3)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Exchange (175)
+- InMemoryTableScan (7)
+- InMemoryRelation (8)
+- AdaptiveSparkPlan (170)
+- == Final Plan ==
ResultQueryStage (140)
+- * Project (139)
+- * BroadcastHashJoin LeftOuter BuildRight (138)
:- Window (44)
: +- * Sort (43)
: +- ShuffleQueryStage (42), Statistics(sizeInBytes=1115.7 KiB, rowCount=2.94E+3)
: +- Exchange (41)
: +- * Project (40)
: +- * Generate (39)
: +- * Project (38)
: +- * Project (37)
: +- * BroadcastHashJoin LeftOuter BuildRight (36)
: :- AQEShuffleRead (17)
: : +- ShuffleQueryStage (16), Statistics(sizeInBytes=798.7 KiB, rowCount=522)
: : +- Exchange (15)
: : +- * Project (14)
: : +- ShuffleQueryStage (13), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: : +- Exchange (12)
: : +- * Filter (11)
: : +- * ColumnarToRow (10)
: : +- Scan parquet (9)
: +- BroadcastQueryStage (35), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
: +- BroadcastExchange (34)
: +- AQEShuffleRead (33)
: +- ShuffleQueryStage (32), Statistics(sizeInBytes=169.7 KiB, rowCount=522)
: +- Exchange (31)
: +- * Project (30)
: +- * BroadcastHashJoin LeftOuter BuildRight (29)
: :- ShuffleQueryStage (21), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: : +- Exchange (20)
: : +- * ColumnarToRow (19)
: : +- Scan parquet (18)
: +- BroadcastQueryStage (28), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
: +- BroadcastExchange (27)
: +- ShuffleQueryStage (26), Statistics(sizeInBytes=1208.0 B, rowCount=6)
: +- Exchange (25)
: +- * Filter (24)
: +- * ColumnarToRow (23)
: +- Scan parquet (22)
+- BroadcastQueryStage (137), Statistics(sizeInBytes=1032.0 KiB, rowCount=177)
+- BroadcastExchange (136)
+- * SerializeFromObject (135)
+- MapPartitions (134)
+- DeserializeToObject (133)
+- AQEShuffleRead (132)
+- ShuffleQueryStage (131), Statistics(sizeInBytes=21.7 KiB, rowCount=177)
+- Exchange (130)
+- * Project (129)
+- TableCacheQueryStage (128), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
+- == Initial Plan ==
Project (169)
+- BroadcastHashJoin LeftOuter BuildRight (168)
:- Window (161)
: +- Sort (160)
: +- Exchange (159)
: +- Project (158)
: +- Generate (157)
: +- Project (156)
: +- Project (155)
: +- SortMergeJoin LeftOuter (154)
: :- Sort (145)
: : +- Exchange (144)
: : +- Project (143)
: : +- Exchange (142)
: : +- Filter (141)
: : +- Scan parquet (9)
: +- Sort (153)
: +- Exchange (152)
: +- Project (151)
: +- BroadcastHashJoin LeftOuter BuildRight (150)
: :- Exchange (146)
: : +- Scan parquet (18)
: +- BroadcastExchange (149)
: +- Exchange (148)
: +- Filter (147)
: +- Scan parquet (22)
+- BroadcastExchange (167)
+- SerializeFromObject (166)
+- MapPartitions (165)
+- DeserializeToObject (164)
+- Exchange (163)
+- Project (162)
+- InMemoryTableScan (45)
+- InMemoryRelation (46)
+- AdaptiveSparkPlan (127)
+- == Final Plan ==
ResultQueryStage (96)
+- * SerializeFromObject (95)
+- MapPartitions (94)
+- DeserializeToObject (93)
+- ShuffleQueryStage (92), Statistics(sizeInBytes=20.3 KiB, rowCount=177)
+- Exchange (91)
+- * Project (90)
+- ObjectHashAggregate (89)
+- AQEShuffleRead (88)
+- ShuffleQueryStage (87), Statistics(sizeInBytes=42.5 KiB, rowCount=441)
+- Exchange (86)
+- ObjectHashAggregate (85)
+- * Project (84)
+- Window (83)
+- * Sort (82)
+- AQEShuffleRead (81)
+- ShuffleQueryStage (80), Statistics(sizeInBytes=321.6 KiB, rowCount=2.94E+3)
+- Exchange (79)
+- * Project (78)
+- * Generate (77)
+- * Project (76)
+- * Project (75)
+- * BroadcastHashJoin LeftOuter BuildRight (74)
:- AQEShuffleRead (55)
: +- ShuffleQueryStage (54), Statistics(sizeInBytes=783.6 KiB, rowCount=522)
: +- Exchange (53)
: +- * Project (52)
: +- ShuffleQueryStage (51), Statistics(sizeInBytes=791.8 KiB, rowCount=522)
: +- Exchange (50)
: +- * Filter (49)
: +- * ColumnarToRow (48)
: +- Scan parquet (47)
+- BroadcastQueryStage (73), Statistics(sizeInBytes=2.0 MiB, rowCount=522)
+- BroadcastExchange (72)
+- AQEShuffleRead (71)
+- ShuffleQueryStage (70), Statistics(sizeInBytes=124.8 KiB, rowCount=522)
+- Exchange (69)
+- * Project (68)
+- * BroadcastHashJoin LeftOuter BuildRight (67)
:- ShuffleQueryStage (59), Statistics(sizeInBytes=84.0 KiB, rowCount=522)
: +- Exchange (58)
: +- * ColumnarToRow (57)
: +- Scan parquet (56)
+- BroadcastQueryStage (66), Statistics(sizeInBytes=2.0 MiB, rowCount=6)
+- BroadcastExchange (65)
+- ShuffleQueryStage (64), Statistics(sizeInBytes=680.0 B, rowCount=6)
+- Exchange (63)
+- * Filter (62)
+- * ColumnarToRow (61)
+- Scan parquet (60)
+- == Initial Plan ==
SerializeFromObject (126)
+- MapPartitions (125)
+- DeserializeToObject (124)
+- Exchange (123)
+- Project (122)
+- ObjectHashAggregate (121)
+- Exchange (120)
+- ObjectHashAggregate (119)
+- Project (118)
+- Window (117)
+- Sort (116)
+- Exchange (115)
+- Project (114)
+- Generate (113)
+- Project (112)
+- Project (111)
+- SortMergeJoin LeftOuter (110)
:- Sort (101)
: +- Exchange (100)
: +- Project (99)
: +- Exchange (98)
: +- Filter (97)
: +- Scan parquet (47)
+- Sort (109)
+- Exchange (108)
+- Project (107)
+- BroadcastHashJoin LeftOuter BuildRight (106)
:- Exchange (102)
: +- Scan parquet (56)
+- BroadcastExchange (105)
+- Exchange (104)
+- Filter (103)
+- Scan parquet (60)
(1) InMemoryTableScan
Output [2]: [sequenceId#727407, shardId#727860]
Arguments: [sequenceId#727407, shardId#727860]
(2) InMemoryRelation
Arguments: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, shardId#727860, worklistShardItemId#727861L, orderProposalItemGroupId#727862, ... 1 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [23]: [availabilityDateTime#727395, binId#727409, clusterId#727406L, deliveryDateTime#727389, isFallbackOrderOnly#727401, mrpController#727397, nextAvailabilityDateTime#727396, orderDateTime#727394, orderProposalHorizonGroupingId#727403L, orderProposalId#727402L, plant#727388, previousOrderProposal#727405L, product#727393, productGroup#727392, purchasingGroup#727400, purchasingOrg#727399, sequenceId#727407, sourceOfSupplyUuid#727398, splitIndicator#727404L, subrange#727390, supplier#727387, supplierGroup#727386, supplyingPlant#727391]
Arguments: [availabilityDateTime#727395, binId#727409, clusterId#727406L, deliveryDateTime#727389, isFallbackOrderOnly#727401, mrpController#727397, nextAvailabilityDateTime#727396, orderDateTime#727394, orderProposalHorizonGroupingId#727403L, orderProposalId#727402L, plant#727388, previousOrderProposal#727405L, product#727393, productGroup#727392, purchasingGroup#727400, purchasingOrg#727399, sequenceId#727407, sourceOfSupplyUuid#727398, splitIndicator#727404L, subrange#727390, supplier#727387, supplierGroup#727386, supplyingPlant#727391]
(4) InMemoryRelation
Arguments: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, avgItemsPerSequence#727408, binId#727409], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
(6) InMemoryRelation
Arguments: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276], StorageLevel(disk, memory, 2 replicas)
(7) InMemoryTableScan
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
(8) InMemoryRelation
Arguments: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276], StorageLevel(disk, memory, 2 replicas)
(9) Scan parquet
Output [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002108]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(10) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
(11) Filter [codegen id : 1]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Condition : ((size(productOrderSchedule#724794, true) > 0) AND isnotnull(productOrderSchedule#724794))
(12) Exchange
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=288470]
(13) ShuffleQueryStage
Output [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Arguments: 0
(14) Project [codegen id : 6]
Output [9]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, CASE WHEN isnotnull(supplyingPlant#724792) THEN productGroup#724793 ELSE subrange#724791 END AS effectiveSubrange#724814]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
(15) Exchange
Input [9]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: hashpartitioning(coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790), 25), ENSURE_REQUIREMENTS, [plan_id=289043]
(16) ShuffleQueryStage
Output [9]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: 7
(17) AQEShuffleRead
Input [9]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: local
(18) Scan parquet
Output [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002108/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(19) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
(20) Exchange
Input [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=288486]
(21) ShuffleQueryStage
Output [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Arguments: 1
(22) Scan parquet
Output [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>,orderSplitCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,multiplesOrderQuantity:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(23) ColumnarToRow [codegen id : 3]
Input [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
(24) Filter [codegen id : 3]
Input [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Condition : isnotnull(orderGroupingProfile#724806)
(25) Exchange
Input [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=288499]
(26) ShuffleQueryStage
Output [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Arguments: 2
(27) BroadcastExchange
Input [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=288507]
(28) BroadcastQueryStage
Output [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Arguments: 6
(29) BroadcastHashJoin [codegen id : 7]
Left keys [1]: [orderGroupingProfile#724799]
Right keys [1]: [orderGroupingProfile#724806]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, subrange#724796 AS effectiveSubrange#724815]
Input [10]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
(31) Exchange
Input [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
Arguments: hashpartitioning(coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798), 25), ENSURE_REQUIREMENTS, [plan_id=289133]
(32) ShuffleQueryStage
Output [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
Arguments: 8
(33) AQEShuffleRead
Input [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
Arguments: local
(34) BroadcastExchange
Input [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[8, string, true], ), isnull(input[8, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=289268]
(35) BroadcastQueryStage
Output [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
Arguments: 9
(36) BroadcastHashJoin [codegen id : 8]
Left keys [10]: [coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790)]
Right keys [10]: [coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798)]
Join type: LeftOuter
Join condition: None
(37) Project [codegen id : 8]
Output [14]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, CASE WHEN isnull(orderGroupCriteria#724808) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#724808 END AS orderGroupCriteria#724827, CASE WHEN isnull(orderSplitCriteria#724809) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#724809 END AS orderSplitCriteria#724837, orderGroupingProfile#724799, coalesce(supplierGroup#724787, supplier#724788) AS supplierOrGroup#724816, coalesce(locationGroup#724801, plant#724789) AS locationOrGroup#724817]
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
(38) Project [codegen id : 8]
Output [26]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827.supplierSubrange AS _extract_supplierSubrange#725419, orderGroupCriteria#724827.mrpController AS _extract_mrpController#725420, orderGroupCriteria#724827.purchasingOrg AS _extract_purchasingOrg#725421, orderGroupCriteria#724827.orderDate AS _extract_orderDate#725422, orderGroupCriteria#724827.deliveryDate AS _extract_deliveryDate#725423, orderGroupCriteria#724827.supplier AS _extract_supplier#725424, orderGroupCriteria#724827.purchasingGroup AS _extract_purchasingGroup#725425, orderSplitCriteria#724837.supplierSubrange AS _extract_supplierSubrange#725426, orderSplitCriteria#724837.mrpController AS _extract_mrpController#725427, orderSplitCriteria#724837.orderDate AS _extract_orderDate#725428, orderSplitCriteria#724837.supplier AS _extract_supplier#725429, orderSplitCriteria#724837.deliveryDate AS _extract_deliveryDate#725430, orderSplitCriteria#724837.purchasingOrg AS _extract_purchasingOrg#725431, orderSplitCriteria#724837.purchasingGroup AS _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Input [14]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827, orderSplitCriteria#724837, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
(39) Generate [codegen id : 8]
Input [26]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, _extract_supplierSubrange#725419, _extract_mrpController#725420, _extract_purchasingOrg#725421, _extract_orderDate#725422, _extract_deliveryDate#725423, _extract_supplier#725424, _extract_purchasingGroup#725425, _extract_supplierSubrange#725426, _extract_mrpController#725427, _extract_orderDate#725428, _extract_supplier#725429, _extract_deliveryDate#725430, _extract_purchasingOrg#725431, _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Arguments: explode(productOrderSchedule#724794), [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, effectiveSubrange#724814, _extract_supplierSubrange#725419, _extract_mrpController#725420, _extract_purchasingOrg#725421, _extract_orderDate#725422, _extract_deliveryDate#725423, _extract_supplier#725424, _extract_purchasingGroup#725425, _extract_supplierSubrange#725426, _extract_mrpController#725427, _extract_orderDate#725428, _extract_supplier#725429, _extract_deliveryDate#725430, _extract_purchasingOrg#725431, _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817], false, [productOrderScheduleExploded#724839]
(40) Project [codegen id : 8]
Output [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderScheduleExploded#724839.product AS product#724840, productOrderScheduleExploded#724839.orderDateTime AS orderDateTime#724841, productOrderScheduleExploded#724839.availabilityDateTime AS availabilityDateTime#724842, productOrderScheduleExploded#724839.nextAvailabilityDateTime AS nextAvailabilityDateTime#724843, productOrderScheduleExploded#724839.mrpController AS mrpController#724844, productOrderScheduleExploded#724839.sourceOfSupplyUuid AS sourceOfSupplyUuid#724845, productOrderScheduleExploded#724839.purchasingOrg AS purchasingOrg#724846, productOrderScheduleExploded#724839.purchasingGroup AS purchasingGroup#724847, productOrderScheduleExploded#724839.isFallbackOrderOnly AS isFallbackOrderOnly#724848, xxhash64(CASE WHEN (_extract_supplierSubrange#725419 <=> true) THEN effectiveSubrange#724814 END, orderGroupingProfile#724799, CASE WHEN (_extract_mrpController#725420 <=> true) THEN productOrderScheduleExploded#724839.mrpController END, CASE WHEN (_extract_purchasingOrg#725421 <=> true) THEN productOrderScheduleExploded#724839.purchasingOrg END, CASE WHEN (_extract_orderDate#725422 <=> true) THEN productOrderScheduleExploded#724839.orderDateTime END, CASE WHEN (_extract_deliveryDate#725423 <=> true) THEN deliveryDateTime#724790 END, CASE WHEN (_extract_supplier#725424 <=> true) THEN supplierOrGroup#724816 END, locationOrGroup#724817, CASE WHEN (_extract_purchasingGroup#725425 <=> true) THEN productOrderScheduleExploded#724839.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#724814) AND (_extract_supplierSubrange#725419 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#724799) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.mrpController) AND (_extract_mrpController#725420 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingOrg) AND (_extract_purchasingOrg#725421 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.orderDateTime) AND (_extract_orderDate#725422 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#724790) AND (_extract_deliveryDate#725423 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#724816) AND (_extract_supplier#725424 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#724817) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingGroup) AND (_extract_purchasingGroup#725425 <=> true)) THEN 256 ELSE 0 END), 10000002108, 42) AS orderProposalId#724875L, xxhash64(CASE WHEN (_extract_supplierSubrange#725426 <=> true) THEN effectiveSubrange#724814 END, orderGroupingProfile#724799, CASE WHEN (_extract_mrpController#725427 <=> true) THEN productOrderScheduleExploded#724839.mrpController END, CASE WHEN (_extract_orderDate#725428 <=> true) THEN productOrderScheduleExploded#724839.orderDateTime END, CASE WHEN (_extract_supplier#725429 <=> true) THEN supplier#724788 END, CASE WHEN (_extract_deliveryDate#725430 <=> true) THEN deliveryDateTime#724790 END, CASE WHEN (_extract_purchasingOrg#725431 <=> true) THEN productOrderScheduleExploded#724839.purchasingOrg END, plant#724789, CASE WHEN (_extract_purchasingGroup#725432 <=> true) THEN productOrderScheduleExploded#724839.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#724814) AND (_extract_supplierSubrange#725426 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#724799) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.mrpController) AND (_extract_mrpController#725427 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.orderDateTime) AND (_extract_orderDate#725428 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#724788) AND (_extract_supplier#725429 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#724790) AND (_extract_deliveryDate#725430 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingOrg) AND (_extract_purchasingOrg#725431 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#724789) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingGroup) AND (_extract_purchasingGroup#725432 <=> true)) THEN 256 ELSE 0 END), 10000002108, 42) AS splitIndicator#724903L]
Input [26]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, effectiveSubrange#724814, _extract_supplierSubrange#725419, _extract_mrpController#725420, _extract_purchasingOrg#725421, _extract_orderDate#725422, _extract_deliveryDate#725423, _extract_supplier#725424, _extract_purchasingGroup#725425, _extract_supplierSubrange#725426, _extract_mrpController#725427, _extract_orderDate#725428, _extract_supplier#725429, _extract_deliveryDate#725430, _extract_purchasingOrg#725431, _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817, productOrderScheduleExploded#724839]
(41) Exchange
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L]
Arguments: hashpartitioning(product#724840, plant#724789, 25), ENSURE_REQUIREMENTS, [plan_id=289349]
(42) ShuffleQueryStage
Output [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L]
Arguments: 10
(43) Sort [codegen id : 9]
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L]
Arguments: [product#724840 ASC NULLS FIRST, plant#724789 ASC NULLS FIRST, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST], false, 0
(44) Window
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L]
Arguments: [lag(orderProposalId#724875L, -1, null) windowspecdefinition(product#724840, plant#724789, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#724904L], [product#724840, plant#724789], [availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST]
(45) InMemoryTableScan
Output [4]: [clusterId#724962L, orderProposalId#724957L, plant#724958, previousOrderProposals#724959]
Arguments: [clusterId#724962L, orderProposalId#724957L, plant#724958, previousOrderProposals#724959]
(46) InMemoryRelation
Arguments: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, nodeId#724960L, dependentOnNodeIds#724961, clusterId#724962L, unresolvedDependencies#724963], StorageLevel(disk, memory, 2 replicas)
(47) Scan parquet
Output [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/grouping-worklist/10000002108]
PushedFilters: [IsNotNull(productOrderSchedule)]
ReadSchema: struct<supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,productOrderSchedule:array<struct<product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,mrpController:string,sourceOfSupplyUuid:string,purchasingOrg:string,purchasingGroup:string,isFallbackOrderOnly:boolean>>>
(48) ColumnarToRow [codegen id : 1]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
(49) Filter [codegen id : 1]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Condition : ((size(productOrderSchedule#724794, true) > 0) AND isnotnull(productOrderSchedule#724794))
(50) Exchange
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=287226]
(51) ShuffleQueryStage
Output [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Arguments: 0
(52) Project [codegen id : 5]
Output [6]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, CASE WHEN isnotnull(supplyingPlant#724792) THEN productGroup#724793 ELSE subrange#724791 END AS effectiveSubrange#724814]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
(53) Exchange
Input [6]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: hashpartitioning(coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790), 25), ENSURE_REQUIREMENTS, [plan_id=287768]
(54) ShuffleQueryStage
Output [6]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: 5
(55) AQEShuffleRead
Input [6]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: local
(56) Scan parquet
Output [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-param-determination-service/out/10000002108/SupplyNetworkProfiles/assignments]
ReadSchema: struct<supplier:string,subrange:string,plant:string,deliverydatetime:timestamp,ordergroupingprofile:string,supplierGroup:string,locationGroup:string>
(57) ColumnarToRow [codegen id : 2]
Input [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
(58) Exchange
Input [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=287242]
(59) ShuffleQueryStage
Output [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Arguments: 1
(60) Scan parquet
Output [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile]
PushedFilters: [IsNotNull(orderGroupingProfile)]
ReadSchema: struct<orderGroupingProfile:string,orderGroupCriteria:struct<supplier:boolean,supplierSubrange:boolean,receivingLocation:boolean,deliveryDate:boolean,orderDate:boolean,purchasingOrg:boolean,purchasingGroup:boolean,mrpController:boolean>>
(61) ColumnarToRow [codegen id : 3]
Input [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
(62) Filter [codegen id : 3]
Input [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Condition : isnotnull(orderGroupingProfile#724806)
(63) Exchange
Input [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=287255]
(64) ShuffleQueryStage
Output [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Arguments: 2
(65) BroadcastExchange
Input [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=287263]
(66) BroadcastQueryStage
Output [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Arguments: 3
(67) BroadcastHashJoin [codegen id : 4]
Left keys [1]: [orderGroupingProfile#724799]
Right keys [1]: [orderGroupingProfile#724806]
Join type: LeftOuter
Join condition: None
(68) Project [codegen id : 4]
Output [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, subrange#724796 AS effectiveSubrange#724815]
Input [9]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupingProfile#724806, orderGroupCriteria#724808]
(69) Exchange
Input [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
Arguments: hashpartitioning(coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798), 25), ENSURE_REQUIREMENTS, [plan_id=287636]
(70) ShuffleQueryStage
Output [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
Arguments: 4
(71) AQEShuffleRead
Input [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
Arguments: local
(72) BroadcastExchange
Input [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
Arguments: HashedRelationBroadcastMode(List(coalesce(input[4, string, true], ), isnull(input[4, string, true]), coalesce(input[0, string, true], ), isnull(input[0, string, true]), coalesce(input[7, string, true], ), isnull(input[7, string, true]), coalesce(input[1, string, true], ), isnull(input[1, string, true]), coalesce(input[2, timestamp, true], 1970-01-01 00:00:00), isnull(input[2, timestamp, true])),false), [plan_id=287889]
(73) BroadcastQueryStage
Output [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
Arguments: 6
(74) BroadcastHashJoin [codegen id : 6]
Left keys [10]: [coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790)]
Right keys [10]: [coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798)]
Join type: LeftOuter
Join condition: None
(75) Project [codegen id : 6]
Output [8]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, CASE WHEN isnull(orderGroupCriteria#724808) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#724808 END AS orderGroupCriteria#724827, orderGroupingProfile#724799, coalesce(supplierGroup#724787, supplier#724788) AS supplierOrGroup#724816, coalesce(locationGroup#724801, plant#724789) AS locationOrGroup#724817]
Input [14]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
(76) Project [codegen id : 6]
Output [14]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827.supplierSubrange AS _extract_supplierSubrange#724964, orderGroupCriteria#724827.mrpController AS _extract_mrpController#724965, orderGroupCriteria#724827.purchasingOrg AS _extract_purchasingOrg#724966, orderGroupCriteria#724827.orderDate AS _extract_orderDate#724967, orderGroupCriteria#724827.deliveryDate AS _extract_deliveryDate#724968, orderGroupCriteria#724827.supplier AS _extract_supplier#724969, orderGroupCriteria#724827.purchasingGroup AS _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Input [8]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
(77) Generate [codegen id : 6]
Input [14]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, _extract_supplierSubrange#724964, _extract_mrpController#724965, _extract_purchasingOrg#724966, _extract_orderDate#724967, _extract_deliveryDate#724968, _extract_supplier#724969, _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Arguments: explode(productOrderSchedule#724794), [plant#724789, deliveryDateTime#724790, effectiveSubrange#724814, _extract_supplierSubrange#724964, _extract_mrpController#724965, _extract_purchasingOrg#724966, _extract_orderDate#724967, _extract_deliveryDate#724968, _extract_supplier#724969, _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817], false, [productOrderScheduleExploded#724839]
(78) Project [codegen id : 6]
Output [5]: [plant#724789, productOrderScheduleExploded#724839.product AS product#724840, productOrderScheduleExploded#724839.orderDateTime AS orderDateTime#724841, productOrderScheduleExploded#724839.availabilityDateTime AS availabilityDateTime#724842, xxhash64(CASE WHEN (_extract_supplierSubrange#724964 <=> true) THEN effectiveSubrange#724814 END, orderGroupingProfile#724799, CASE WHEN (_extract_mrpController#724965 <=> true) THEN productOrderScheduleExploded#724839.mrpController END, CASE WHEN (_extract_purchasingOrg#724966 <=> true) THEN productOrderScheduleExploded#724839.purchasingOrg END, CASE WHEN (_extract_orderDate#724967 <=> true) THEN productOrderScheduleExploded#724839.orderDateTime END, CASE WHEN (_extract_deliveryDate#724968 <=> true) THEN deliveryDateTime#724790 END, CASE WHEN (_extract_supplier#724969 <=> true) THEN supplierOrGroup#724816 END, locationOrGroup#724817, CASE WHEN (_extract_purchasingGroup#724970 <=> true) THEN productOrderScheduleExploded#724839.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#724814) AND (_extract_supplierSubrange#724964 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#724799) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.mrpController) AND (_extract_mrpController#724965 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingOrg) AND (_extract_purchasingOrg#724966 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.orderDateTime) AND (_extract_orderDate#724967 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#724790) AND (_extract_deliveryDate#724968 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#724816) AND (_extract_supplier#724969 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#724817) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingGroup) AND (_extract_purchasingGroup#724970 <=> true)) THEN 256 ELSE 0 END), 10000002108, 42) AS orderProposalId#724875L]
Input [14]: [plant#724789, deliveryDateTime#724790, effectiveSubrange#724814, _extract_supplierSubrange#724964, _extract_mrpController#724965, _extract_purchasingOrg#724966, _extract_orderDate#724967, _extract_deliveryDate#724968, _extract_supplier#724969, _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817, productOrderScheduleExploded#724839]
(79) Exchange
Input [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: hashpartitioning(product#724840, plant#724789, 25), ENSURE_REQUIREMENTS, [plan_id=288073]
(80) ShuffleQueryStage
Output [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: 7
(81) AQEShuffleRead
Input [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: coalesced
(82) Sort [codegen id : 7]
Input [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: [product#724840 ASC NULLS FIRST, plant#724789 ASC NULLS FIRST, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST], false, 0
(83) Window
Input [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: [lag(orderProposalId#724875L, -1, null) windowspecdefinition(product#724840, plant#724789, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#724904L], [product#724840, plant#724789], [availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST]
(84) Project [codegen id : 8]
Output [3]: [plant#724789, orderProposalId#724875L, previousOrderProposal#724904L]
Input [6]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L, previousOrderProposal#724904L]
(85) ObjectHashAggregate
Input [3]: [plant#724789, orderProposalId#724875L, previousOrderProposal#724904L]
Keys [1]: [orderProposalId#724875L]
Functions [2]: [partial_min(plant#724789), partial_collect_set(previousOrderProposal#724904L, 0, 0)]
Aggregate Attributes [2]: [min#725037, buf#725038]
Results [3]: [orderProposalId#724875L, min#725039, buf#725040]
(86) Exchange
Input [3]: [orderProposalId#724875L, min#725039, buf#725040]
Arguments: hashpartitioning(orderProposalId#724875L, 25), ENSURE_REQUIREMENTS, [plan_id=288171]
(87) ShuffleQueryStage
Output [3]: [orderProposalId#724875L, min#725039, buf#725040]
Arguments: 8
(88) AQEShuffleRead
Input [3]: [orderProposalId#724875L, min#725039, buf#725040]
Arguments: coalesced
(89) ObjectHashAggregate
Input [3]: [orderProposalId#724875L, min#725039, buf#725040]
Keys [1]: [orderProposalId#724875L]
Functions [2]: [min(plant#724789), collect_set(previousOrderProposal#724904L, 0, 0)]
Aggregate Attributes [2]: [min(plant#724789)#724927, collect_set(previousOrderProposal#724904L, 0, 0)#724928]
Results [4]: [orderProposalId#724875L, min(plant#724789)#724927 AS plant#724905, collect_set(previousOrderProposal#724904L, 0, 0)#724928 AS previousOrderProposals#724906, orderProposalId#724875L AS nodeId#724929L]
(90) Project [codegen id : 9]
Output [5]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L, previousOrderProposals#724906 AS dependentOnNodeIds#724930]
Input [4]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L]
(91) Exchange
Input [5]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L, dependentOnNodeIds#724930]
Arguments: hashpartitioning(plant#724905, 25), REPARTITION_BY_COL, [plan_id=288223]
(92) ShuffleQueryStage
Output [5]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L, dependentOnNodeIds#724930]
Arguments: 9
(93) DeserializeToObject
Input [5]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L, dependentOnNodeIds#724930]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#724875L)), invoke(plant#724905.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#724906, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#724929L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#724930, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#724941: org.apache.spark.sql.Row
(94) MapPartitions
Input [1]: [obj#724941]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@5aa0a601, obj#724949: org.apache.spark.sql.Row
(95) SerializeFromObject [codegen id : 10]
Input [1]: [obj#724949]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#724957L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#724958, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#724959, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#724960L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#724961, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#724962L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#724963]
(96) ResultQueryStage
Output [7]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, nodeId#724960L, dependentOnNodeIds#724961, clusterId#724962L, unresolvedDependencies#724963]
Arguments: 10
(97) Filter
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Condition : ((size(productOrderSchedule#724794, true) > 0) AND isnotnull(productOrderSchedule#724794))
(98) Exchange
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=287104]
(99) Project
Output [6]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, CASE WHEN isnotnull(supplyingPlant#724792) THEN productGroup#724793 ELSE subrange#724791 END AS effectiveSubrange#724814]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
(100) Exchange
Input [6]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: hashpartitioning(coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790), 25), ENSURE_REQUIREMENTS, [plan_id=287128]
(101) Sort
Input [6]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: [coalesce(supplierGroup#724787, ) ASC NULLS FIRST, isnull(supplierGroup#724787) ASC NULLS FIRST, coalesce(supplier#724788, ) ASC NULLS FIRST, isnull(supplier#724788) ASC NULLS FIRST, coalesce(effectiveSubrange#724814, ) ASC NULLS FIRST, isnull(effectiveSubrange#724814) ASC NULLS FIRST, coalesce(plant#724789, ) ASC NULLS FIRST, isnull(plant#724789) ASC NULLS FIRST, coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#724790) ASC NULLS FIRST], false, 0
(102) Exchange
Input [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=287082]
(103) Filter
Input [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Condition : isnotnull(orderGroupingProfile#724806)
(104) Exchange
Input [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=287106]
(105) BroadcastExchange
Input [2]: [orderGroupingProfile#724806, orderGroupCriteria#724808]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=287123]
(106) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#724799]
Right keys [1]: [orderGroupingProfile#724806]
Join type: LeftOuter
Join condition: None
(107) Project
Output [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, subrange#724796 AS effectiveSubrange#724815]
Input [9]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupingProfile#724806, orderGroupCriteria#724808]
(108) Exchange
Input [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
Arguments: hashpartitioning(coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798), 25), ENSURE_REQUIREMENTS, [plan_id=287129]
(109) Sort
Input [8]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
Arguments: [coalesce(supplierGroup#724800, ) ASC NULLS FIRST, isnull(supplierGroup#724800) ASC NULLS FIRST, coalesce(supplier#724795, ) ASC NULLS FIRST, isnull(supplier#724795) ASC NULLS FIRST, coalesce(effectiveSubrange#724815, ) ASC NULLS FIRST, isnull(effectiveSubrange#724815) ASC NULLS FIRST, coalesce(plant#724797, ) ASC NULLS FIRST, isnull(plant#724797) ASC NULLS FIRST, coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#724798) ASC NULLS FIRST], false, 0
(110) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790)]
Right keys [10]: [coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798)]
Join type: LeftOuter
Join condition: None
(111) Project
Output [8]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, CASE WHEN isnull(orderGroupCriteria#724808) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#724808 END AS orderGroupCriteria#724827, orderGroupingProfile#724799, coalesce(supplierGroup#724787, supplier#724788) AS supplierOrGroup#724816, coalesce(locationGroup#724801, plant#724789) AS locationOrGroup#724817]
Input [14]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, effectiveSubrange#724815]
(112) Project
Output [14]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827.supplierSubrange AS _extract_supplierSubrange#724964, orderGroupCriteria#724827.mrpController AS _extract_mrpController#724965, orderGroupCriteria#724827.purchasingOrg AS _extract_purchasingOrg#724966, orderGroupCriteria#724827.orderDate AS _extract_orderDate#724967, orderGroupCriteria#724827.deliveryDate AS _extract_deliveryDate#724968, orderGroupCriteria#724827.supplier AS _extract_supplier#724969, orderGroupCriteria#724827.purchasingGroup AS _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Input [8]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
(113) Generate
Input [14]: [plant#724789, deliveryDateTime#724790, productOrderSchedule#724794, effectiveSubrange#724814, _extract_supplierSubrange#724964, _extract_mrpController#724965, _extract_purchasingOrg#724966, _extract_orderDate#724967, _extract_deliveryDate#724968, _extract_supplier#724969, _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Arguments: explode(productOrderSchedule#724794), [plant#724789, deliveryDateTime#724790, effectiveSubrange#724814, _extract_supplierSubrange#724964, _extract_mrpController#724965, _extract_purchasingOrg#724966, _extract_orderDate#724967, _extract_deliveryDate#724968, _extract_supplier#724969, _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817], false, [productOrderScheduleExploded#724839]
(114) Project
Output [5]: [plant#724789, productOrderScheduleExploded#724839.product AS product#724840, productOrderScheduleExploded#724839.orderDateTime AS orderDateTime#724841, productOrderScheduleExploded#724839.availabilityDateTime AS availabilityDateTime#724842, xxhash64(CASE WHEN (_extract_supplierSubrange#724964 <=> true) THEN effectiveSubrange#724814 END, orderGroupingProfile#724799, CASE WHEN (_extract_mrpController#724965 <=> true) THEN productOrderScheduleExploded#724839.mrpController END, CASE WHEN (_extract_purchasingOrg#724966 <=> true) THEN productOrderScheduleExploded#724839.purchasingOrg END, CASE WHEN (_extract_orderDate#724967 <=> true) THEN productOrderScheduleExploded#724839.orderDateTime END, CASE WHEN (_extract_deliveryDate#724968 <=> true) THEN deliveryDateTime#724790 END, CASE WHEN (_extract_supplier#724969 <=> true) THEN supplierOrGroup#724816 END, locationOrGroup#724817, CASE WHEN (_extract_purchasingGroup#724970 <=> true) THEN productOrderScheduleExploded#724839.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#724814) AND (_extract_supplierSubrange#724964 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#724799) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.mrpController) AND (_extract_mrpController#724965 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingOrg) AND (_extract_purchasingOrg#724966 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.orderDateTime) AND (_extract_orderDate#724967 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#724790) AND (_extract_deliveryDate#724968 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#724816) AND (_extract_supplier#724969 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#724817) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingGroup) AND (_extract_purchasingGroup#724970 <=> true)) THEN 256 ELSE 0 END), 10000002108, 42) AS orderProposalId#724875L]
Input [14]: [plant#724789, deliveryDateTime#724790, effectiveSubrange#724814, _extract_supplierSubrange#724964, _extract_mrpController#724965, _extract_purchasingOrg#724966, _extract_orderDate#724967, _extract_deliveryDate#724968, _extract_supplier#724969, _extract_purchasingGroup#724970, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817, productOrderScheduleExploded#724839]
(115) Exchange
Input [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: hashpartitioning(product#724840, plant#724789, 25), ENSURE_REQUIREMENTS, [plan_id=287138]
(116) Sort
Input [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: [product#724840 ASC NULLS FIRST, plant#724789 ASC NULLS FIRST, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST], false, 0
(117) Window
Input [5]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L]
Arguments: [lag(orderProposalId#724875L, -1, null) windowspecdefinition(product#724840, plant#724789, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#724904L], [product#724840, plant#724789], [availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST]
(118) Project
Output [3]: [plant#724789, orderProposalId#724875L, previousOrderProposal#724904L]
Input [6]: [plant#724789, product#724840, orderDateTime#724841, availabilityDateTime#724842, orderProposalId#724875L, previousOrderProposal#724904L]
(119) ObjectHashAggregate
Input [3]: [plant#724789, orderProposalId#724875L, previousOrderProposal#724904L]
Keys [1]: [orderProposalId#724875L]
Functions [2]: [partial_min(plant#724789), partial_collect_set(previousOrderProposal#724904L, 0, 0)]
Aggregate Attributes [2]: [min#725037, buf#725038]
Results [3]: [orderProposalId#724875L, min#725039, buf#725040]
(120) Exchange
Input [3]: [orderProposalId#724875L, min#725039, buf#725040]
Arguments: hashpartitioning(orderProposalId#724875L, 25), ENSURE_REQUIREMENTS, [plan_id=287144]
(121) ObjectHashAggregate
Input [3]: [orderProposalId#724875L, min#725039, buf#725040]
Keys [1]: [orderProposalId#724875L]
Functions [2]: [min(plant#724789), collect_set(previousOrderProposal#724904L, 0, 0)]
Aggregate Attributes [2]: [min(plant#724789)#724927, collect_set(previousOrderProposal#724904L, 0, 0)#724928]
Results [4]: [orderProposalId#724875L, min(plant#724789)#724927 AS plant#724905, collect_set(previousOrderProposal#724904L, 0, 0)#724928 AS previousOrderProposals#724906, orderProposalId#724875L AS nodeId#724929L]
(122) Project
Output [5]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L, previousOrderProposals#724906 AS dependentOnNodeIds#724930]
Input [4]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L]
(123) Exchange
Input [5]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L, dependentOnNodeIds#724930]
Arguments: hashpartitioning(plant#724905, 25), REPARTITION_BY_COL, [plan_id=287147]
(124) DeserializeToObject
Input [5]: [orderProposalId#724875L, plant#724905, previousOrderProposals#724906, nodeId#724929L, dependentOnNodeIds#724930]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#724875L)), invoke(plant#724905.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -4), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -4))), previousOrderProposals#724906, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(nodeId#724929L)), mapobjects(lambdavariable(MapObject, LongType, false, -5), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -5))), dependentOnNodeIds#724930, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#724941: org.apache.spark.sql.Row
(125) MapPartitions
Input [1]: [obj#724941]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@5aa0a601, obj#724949: org.apache.spark.sql.Row
(126) SerializeFromObject
Input [1]: [obj#724949]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#724957L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, plant), StringType, ObjectType(class java.lang.String)))) AS plant#724958, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, previousOrderProposals), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS previousOrderProposals#724959, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, nodeId), LongType, ObjectType(class java.lang.Long)).longValue())) AS nodeId#724960L, if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), assertnotnull(invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -2), LongType, ObjectType(class java.lang.Long)).longValue())), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, dependentOnNodeIds), ArrayType(LongType,false), ObjectType(class java.lang.Object)), None) AS dependentOnNodeIds#724961, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#724962L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else if (invoke(class [J.isInstance(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object))))) static_invoke(ArrayData.toArrayData(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)))) else mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), invoke(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -3), LongType, ObjectType(class java.lang.Long)).longValue()), validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, unresolvedDependencies), ArrayType(LongType,true), ObjectType(class java.lang.Object)), None) AS unresolvedDependencies#724963]
(127) AdaptiveSparkPlan
Output [7]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, nodeId#724960L, dependentOnNodeIds#724961, clusterId#724962L, unresolvedDependencies#724963]
Arguments: isFinalPlan=true
(128) TableCacheQueryStage
Output [4]: [clusterId#724962L, orderProposalId#724957L, plant#724958, previousOrderProposals#724959]
Arguments: 3
(129) Project [codegen id : 4]
Output [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, orderProposalId#724957L AS nodeId#725240L, previousOrderProposals#724959 AS dependentOnNodeIds#725241]
Input [4]: [clusterId#724962L, orderProposalId#724957L, plant#724958, previousOrderProposals#724959]
(130) Exchange
Input [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, nodeId#725240L, dependentOnNodeIds#725241]
Arguments: hashpartitioning(clusterId#724962L, 25), REPARTITION_BY_COL, [plan_id=288656]
(131) ShuffleQueryStage
Output [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, nodeId#725240L, dependentOnNodeIds#725241]
Arguments: 4
(132) AQEShuffleRead
Input [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, nodeId#725240L, dependentOnNodeIds#725241]
Arguments: coalesced
(133) DeserializeToObject
Input [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, nodeId#725240L, dependentOnNodeIds#725241]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#724957L)), invoke(plant#724958.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#724959, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#724962L)), static_invoke(java.lang.Long.valueOf(nodeId#725240L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#725241, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#725254: org.apache.spark.sql.Row
(134) MapPartitions
Input [1]: [obj#725254]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@4a94c174, obj#725262: org.apache.spark.sql.Row
(135) SerializeFromObject [codegen id : 5]
Input [1]: [obj#725262]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#725270L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#725273L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#725276]
(136) BroadcastExchange
Input [3]: [orderProposalId#725270L, clusterId#725273L, sequenceId#725276]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=288755]
(137) BroadcastQueryStage
Output [3]: [orderProposalId#725270L, clusterId#725273L, sequenceId#725276]
Arguments: 5
(138) BroadcastHashJoin [codegen id : 10]
Left keys [1]: [orderProposalId#724875L]
Right keys [1]: [orderProposalId#725270L]
Join type: LeftOuter
Join condition: None
(139) Project [codegen id : 10]
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, 0 AS orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L, previousOrderProposal#724904L, orderProposalId#725270L, clusterId#725273L, sequenceId#725276]
(140) ResultQueryStage
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: 11
(141) Filter
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Condition : ((size(productOrderSchedule#724794, true) > 0) AND isnotnull(productOrderSchedule#724794))
(142) Exchange
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=288370]
(143) Project
Output [9]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, CASE WHEN isnotnull(supplyingPlant#724792) THEN productGroup#724793 ELSE subrange#724791 END AS effectiveSubrange#724814]
Input [8]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794]
(144) Exchange
Input [9]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: hashpartitioning(coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790), 25), ENSURE_REQUIREMENTS, [plan_id=288388]
(145) Sort
Input [9]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814]
Arguments: [coalesce(supplierGroup#724787, ) ASC NULLS FIRST, isnull(supplierGroup#724787) ASC NULLS FIRST, coalesce(supplier#724788, ) ASC NULLS FIRST, isnull(supplier#724788) ASC NULLS FIRST, coalesce(effectiveSubrange#724814, ) ASC NULLS FIRST, isnull(effectiveSubrange#724814) ASC NULLS FIRST, coalesce(plant#724789, ) ASC NULLS FIRST, isnull(plant#724789) ASC NULLS FIRST, coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#724790) ASC NULLS FIRST], false, 0
(146) Exchange
Input [7]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=288348]
(147) Filter
Input [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Condition : isnotnull(orderGroupingProfile#724806)
(148) Exchange
Input [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=288372]
(149) BroadcastExchange
Input [3]: [orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [plan_id=288383]
(150) BroadcastHashJoin
Left keys [1]: [orderGroupingProfile#724799]
Right keys [1]: [orderGroupingProfile#724806]
Join type: LeftOuter
Join condition: None
(151) Project
Output [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, subrange#724796 AS effectiveSubrange#724815]
Input [10]: [supplier#724795, subrange#724796, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupingProfile#724806, orderGroupCriteria#724808, orderSplitCriteria#724809]
(152) Exchange
Input [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
Arguments: hashpartitioning(coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798), 25), ENSURE_REQUIREMENTS, [plan_id=288389]
(153) Sort
Input [9]: [supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
Arguments: [coalesce(supplierGroup#724800, ) ASC NULLS FIRST, isnull(supplierGroup#724800) ASC NULLS FIRST, coalesce(supplier#724795, ) ASC NULLS FIRST, isnull(supplier#724795) ASC NULLS FIRST, coalesce(effectiveSubrange#724815, ) ASC NULLS FIRST, isnull(effectiveSubrange#724815) ASC NULLS FIRST, coalesce(plant#724797, ) ASC NULLS FIRST, isnull(plant#724797) ASC NULLS FIRST, coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00) ASC NULLS FIRST, isnull(deliveryDateTime#724798) ASC NULLS FIRST], false, 0
(154) SortMergeJoin
Left keys [10]: [coalesce(supplierGroup#724787, ), isnull(supplierGroup#724787), coalesce(supplier#724788, ), isnull(supplier#724788), coalesce(effectiveSubrange#724814, ), isnull(effectiveSubrange#724814), coalesce(plant#724789, ), isnull(plant#724789), coalesce(deliveryDateTime#724790, 1970-01-01 00:00:00), isnull(deliveryDateTime#724790)]
Right keys [10]: [coalesce(supplierGroup#724800, ), isnull(supplierGroup#724800), coalesce(supplier#724795, ), isnull(supplier#724795), coalesce(effectiveSubrange#724815, ), isnull(effectiveSubrange#724815), coalesce(plant#724797, ), isnull(plant#724797), coalesce(deliveryDateTime#724798, 1970-01-01 00:00:00), isnull(deliveryDateTime#724798)]
Join type: LeftOuter
Join condition: None
(155) Project
Output [14]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, CASE WHEN isnull(orderGroupCriteria#724808) THEN [true,false,false,false,true,false,false,false] ELSE orderGroupCriteria#724808 END AS orderGroupCriteria#724827, CASE WHEN isnull(orderSplitCriteria#724809) THEN [true,false,false,false,false,true,false,false,false] ELSE orderSplitCriteria#724809 END AS orderSplitCriteria#724837, orderGroupingProfile#724799, coalesce(supplierGroup#724787, supplier#724788) AS supplierOrGroup#724816, coalesce(locationGroup#724801, plant#724789) AS locationOrGroup#724817]
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, supplier#724795, plant#724797, deliverydatetime#724798, ordergroupingprofile#724799, supplierGroup#724800, locationGroup#724801, orderGroupCriteria#724808, orderSplitCriteria#724809, effectiveSubrange#724815]
(156) Project
Output [26]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827.supplierSubrange AS _extract_supplierSubrange#725419, orderGroupCriteria#724827.mrpController AS _extract_mrpController#725420, orderGroupCriteria#724827.purchasingOrg AS _extract_purchasingOrg#725421, orderGroupCriteria#724827.orderDate AS _extract_orderDate#725422, orderGroupCriteria#724827.deliveryDate AS _extract_deliveryDate#725423, orderGroupCriteria#724827.supplier AS _extract_supplier#725424, orderGroupCriteria#724827.purchasingGroup AS _extract_purchasingGroup#725425, orderSplitCriteria#724837.supplierSubrange AS _extract_supplierSubrange#725426, orderSplitCriteria#724837.mrpController AS _extract_mrpController#725427, orderSplitCriteria#724837.orderDate AS _extract_orderDate#725428, orderSplitCriteria#724837.supplier AS _extract_supplier#725429, orderSplitCriteria#724837.deliveryDate AS _extract_deliveryDate#725430, orderSplitCriteria#724837.purchasingOrg AS _extract_purchasingOrg#725431, orderSplitCriteria#724837.purchasingGroup AS _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Input [14]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, orderGroupCriteria#724827, orderSplitCriteria#724837, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
(157) Generate
Input [26]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderSchedule#724794, effectiveSubrange#724814, _extract_supplierSubrange#725419, _extract_mrpController#725420, _extract_purchasingOrg#725421, _extract_orderDate#725422, _extract_deliveryDate#725423, _extract_supplier#725424, _extract_purchasingGroup#725425, _extract_supplierSubrange#725426, _extract_mrpController#725427, _extract_orderDate#725428, _extract_supplier#725429, _extract_deliveryDate#725430, _extract_purchasingOrg#725431, _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817]
Arguments: explode(productOrderSchedule#724794), [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, effectiveSubrange#724814, _extract_supplierSubrange#725419, _extract_mrpController#725420, _extract_purchasingOrg#725421, _extract_orderDate#725422, _extract_deliveryDate#725423, _extract_supplier#725424, _extract_purchasingGroup#725425, _extract_supplierSubrange#725426, _extract_mrpController#725427, _extract_orderDate#725428, _extract_supplier#725429, _extract_deliveryDate#725430, _extract_purchasingOrg#725431, _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817], false, [productOrderScheduleExploded#724839]
(158) Project
Output [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, productOrderScheduleExploded#724839.product AS product#724840, productOrderScheduleExploded#724839.orderDateTime AS orderDateTime#724841, productOrderScheduleExploded#724839.availabilityDateTime AS availabilityDateTime#724842, productOrderScheduleExploded#724839.nextAvailabilityDateTime AS nextAvailabilityDateTime#724843, productOrderScheduleExploded#724839.mrpController AS mrpController#724844, productOrderScheduleExploded#724839.sourceOfSupplyUuid AS sourceOfSupplyUuid#724845, productOrderScheduleExploded#724839.purchasingOrg AS purchasingOrg#724846, productOrderScheduleExploded#724839.purchasingGroup AS purchasingGroup#724847, productOrderScheduleExploded#724839.isFallbackOrderOnly AS isFallbackOrderOnly#724848, xxhash64(CASE WHEN (_extract_supplierSubrange#725419 <=> true) THEN effectiveSubrange#724814 END, orderGroupingProfile#724799, CASE WHEN (_extract_mrpController#725420 <=> true) THEN productOrderScheduleExploded#724839.mrpController END, CASE WHEN (_extract_purchasingOrg#725421 <=> true) THEN productOrderScheduleExploded#724839.purchasingOrg END, CASE WHEN (_extract_orderDate#725422 <=> true) THEN productOrderScheduleExploded#724839.orderDateTime END, CASE WHEN (_extract_deliveryDate#725423 <=> true) THEN deliveryDateTime#724790 END, CASE WHEN (_extract_supplier#725424 <=> true) THEN supplierOrGroup#724816 END, locationOrGroup#724817, CASE WHEN (_extract_purchasingGroup#725425 <=> true) THEN productOrderScheduleExploded#724839.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#724814) AND (_extract_supplierSubrange#725419 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#724799) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.mrpController) AND (_extract_mrpController#725420 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingOrg) AND (_extract_purchasingOrg#725421 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.orderDateTime) AND (_extract_orderDate#725422 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#724790) AND (_extract_deliveryDate#725423 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(supplierOrGroup#724816) AND (_extract_supplier#725424 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(locationOrGroup#724817) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingGroup) AND (_extract_purchasingGroup#725425 <=> true)) THEN 256 ELSE 0 END), 10000002108, 42) AS orderProposalId#724875L, xxhash64(CASE WHEN (_extract_supplierSubrange#725426 <=> true) THEN effectiveSubrange#724814 END, orderGroupingProfile#724799, CASE WHEN (_extract_mrpController#725427 <=> true) THEN productOrderScheduleExploded#724839.mrpController END, CASE WHEN (_extract_orderDate#725428 <=> true) THEN productOrderScheduleExploded#724839.orderDateTime END, CASE WHEN (_extract_supplier#725429 <=> true) THEN supplier#724788 END, CASE WHEN (_extract_deliveryDate#725430 <=> true) THEN deliveryDateTime#724790 END, CASE WHEN (_extract_purchasingOrg#725431 <=> true) THEN productOrderScheduleExploded#724839.purchasingOrg END, plant#724789, CASE WHEN (_extract_purchasingGroup#725432 <=> true) THEN productOrderScheduleExploded#724839.purchasingGroup END, ((((((((CASE WHEN (isnull(effectiveSubrange#724814) AND (_extract_supplierSubrange#725426 <=> true)) THEN 1 ELSE 0 END + CASE WHEN isnull(orderGroupingProfile#724799) THEN 2 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.mrpController) AND (_extract_mrpController#725427 <=> true)) THEN 4 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.orderDateTime) AND (_extract_orderDate#725428 <=> true)) THEN 8 ELSE 0 END) + CASE WHEN (isnull(supplier#724788) AND (_extract_supplier#725429 <=> true)) THEN 16 ELSE 0 END) + CASE WHEN (isnull(deliveryDateTime#724790) AND (_extract_deliveryDate#725430 <=> true)) THEN 32 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingOrg) AND (_extract_purchasingOrg#725431 <=> true)) THEN 64 ELSE 0 END) + CASE WHEN isnull(plant#724789) THEN 128 ELSE 0 END) + CASE WHEN (isnull(productOrderScheduleExploded#724839.purchasingGroup) AND (_extract_purchasingGroup#725432 <=> true)) THEN 256 ELSE 0 END), 10000002108, 42) AS splitIndicator#724903L]
Input [26]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, effectiveSubrange#724814, _extract_supplierSubrange#725419, _extract_mrpController#725420, _extract_purchasingOrg#725421, _extract_orderDate#725422, _extract_deliveryDate#725423, _extract_supplier#725424, _extract_purchasingGroup#725425, _extract_supplierSubrange#725426, _extract_mrpController#725427, _extract_orderDate#725428, _extract_supplier#725429, _extract_deliveryDate#725430, _extract_purchasingOrg#725431, _extract_purchasingGroup#725432, orderGroupingProfile#724799, supplierOrGroup#724816, locationOrGroup#724817, productOrderScheduleExploded#724839]
(159) Exchange
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L]
Arguments: hashpartitioning(product#724840, plant#724789, 25), ENSURE_REQUIREMENTS, [plan_id=288398]
(160) Sort
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L]
Arguments: [product#724840 ASC NULLS FIRST, plant#724789 ASC NULLS FIRST, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST], false, 0
(161) Window
Input [18]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L]
Arguments: [lag(orderProposalId#724875L, -1, null) windowspecdefinition(product#724840, plant#724789, availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST, specifiedwindowframe(RowFrame, -1, -1)) AS previousOrderProposal#724904L], [product#724840, plant#724789], [availabilityDateTime#724842 ASC NULLS FIRST, orderDateTime#724841 ASC NULLS FIRST, orderProposalId#724875L ASC NULLS FIRST]
(162) Project
Output [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, orderProposalId#724957L AS nodeId#725240L, previousOrderProposals#724959 AS dependentOnNodeIds#725241]
Input [4]: [clusterId#724962L, orderProposalId#724957L, plant#724958, previousOrderProposals#724959]
(163) Exchange
Input [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, nodeId#725240L, dependentOnNodeIds#725241]
Arguments: hashpartitioning(clusterId#724962L, 25), REPARTITION_BY_COL, [plan_id=288363]
(164) DeserializeToObject
Input [6]: [orderProposalId#724957L, plant#724958, previousOrderProposals#724959, clusterId#724962L, nodeId#725240L, dependentOnNodeIds#725241]
Arguments: createexternalrow(static_invoke(java.lang.Long.valueOf(orderProposalId#724957L)), invoke(plant#724958.toString()), mapobjects(lambdavariable(MapObject, LongType, false, -1), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -1))), previousOrderProposals#724959, Some(class scala.collection.mutable.ArraySeq)), static_invoke(java.lang.Long.valueOf(clusterId#724962L)), static_invoke(java.lang.Long.valueOf(nodeId#725240L)), mapobjects(lambdavariable(MapObject, LongType, false, -2), static_invoke(java.lang.Long.valueOf(lambdavariable(MapObject, LongType, false, -2))), dependentOnNodeIds#725241, Some(class scala.collection.mutable.ArraySeq)), StructField(orderProposalId,LongType,false), StructField(plant,StringType,true), StructField(previousOrderProposals,ArrayType(LongType,false),false), StructField(clusterId,LongType,true), StructField(nodeId,LongType,false), StructField(dependentOnNodeIds,ArrayType(LongType,false),false)), obj#725254: org.apache.spark.sql.Row
(165) MapPartitions
Input [1]: [obj#725254]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@4a94c174, obj#725262: org.apache.spark.sql.Row
(166) SerializeFromObject
Input [1]: [obj#725262]
Arguments: [assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#725270L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#725273L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#725276]
(167) BroadcastExchange
Input [3]: [orderProposalId#725270L, clusterId#725273L, sequenceId#725276]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, false]),false), [plan_id=288402]
(168) BroadcastHashJoin
Left keys [1]: [orderProposalId#724875L]
Right keys [1]: [orderProposalId#725270L]
Join type: LeftOuter
Join condition: None
(169) Project
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, 0 AS orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, splitIndicator#724903L, previousOrderProposal#724904L, orderProposalId#725270L, clusterId#725273L, sequenceId#725276]
(170) AdaptiveSparkPlan
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: isFinalPlan=true
(171) TableCacheQueryStage
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: 0
(172) Exchange
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=289629]
(173) ShuffleQueryStage
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: 1
(174) ResultQueryStage
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: 2
(175) Exchange
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=289547]
(176) AdaptiveSparkPlan
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: isFinalPlan=true
(177) TableCacheQueryStage
Output [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: 0
(178) Sort [codegen id : 1]
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: [clusterId#725273L ASC NULLS FIRST], false, 0
(179) Window
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: [count(1) windowspecdefinition(clusterId#725273L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#727288L, max(sequenceId#725276) windowspecdefinition(clusterId#725273L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#727289], [clusterId#725273L]
(180) Project [codegen id : 2]
Output [23]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276, (cast(_we0#727288L as double) / cast((_we1#727289 + 1) as double)) AS avgItemsPerSequence#727285]
Input [24]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276, _we0#727288L, _we1#727289]
(181) DeserializeToObject
Input [23]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276, avgItemsPerSequence#727285]
Arguments: createexternalrow(invoke(supplierGroup#724787.toString()), invoke(supplier#724788.toString()), invoke(plant#724789.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#724790)), invoke(subrange#724791.toString()), invoke(supplyingPlant#724792.toString()), invoke(productGroup#724793.toString()), invoke(product#724840.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#724841)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#724842)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#724843)), invoke(mrpController#724844.toString()), invoke(sourceOfSupplyUuid#724845.toString()), invoke(purchasingOrg#724846.toString()), invoke(purchasingGroup#724847.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#724848)), static_invoke(java.lang.Long.valueOf(orderProposalId#724875L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#724876L)), static_invoke(java.lang.Long.valueOf(splitIndicator#724903L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#724904L)), static_invoke(java.lang.Long.valueOf(clusterId#725273L)), static_invoke(java.lang.Integer.valueOf(sequenceId#725276)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#727285)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#727336: org.apache.spark.sql.Row
(182) MapPartitions
Input [1]: [obj#727336]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@2ec20285, obj#727361: org.apache.spark.sql.Row
(183) SerializeFromObject [codegen id : 3]
Input [1]: [obj#727361]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#727386, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#727387, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#727388, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#727389, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#727390, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#727391, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#727392, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#727393, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#727394, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#727395, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#727396, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#727397, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#727398, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#727399, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#727400, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#727401, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#727402L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#727403L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#727404L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#727405L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#727406L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#727407, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#727408, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#727409]
(184) ResultQueryStage
Output [24]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, avgItemsPerSequence#727408, binId#727409]
Arguments: 1
(185) Exchange
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: hashpartitioning(clusterId#725273L, 25), ENSURE_REQUIREMENTS, [plan_id=289573]
(186) Sort
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: [clusterId#725273L ASC NULLS FIRST], false, 0
(187) Window
Input [22]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276]
Arguments: [count(1) windowspecdefinition(clusterId#725273L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#727288L, max(sequenceId#725276) windowspecdefinition(clusterId#725273L, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we1#727289], [clusterId#725273L]
(188) Project
Output [23]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276, (cast(_we0#727288L as double) / cast((_we1#727289 + 1) as double)) AS avgItemsPerSequence#727285]
Input [24]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276, _we0#727288L, _we1#727289]
(189) DeserializeToObject
Input [23]: [supplierGroup#724787, supplier#724788, plant#724789, deliveryDateTime#724790, subrange#724791, supplyingPlant#724792, productGroup#724793, product#724840, orderDateTime#724841, availabilityDateTime#724842, nextAvailabilityDateTime#724843, mrpController#724844, sourceOfSupplyUuid#724845, purchasingOrg#724846, purchasingGroup#724847, isFallbackOrderOnly#724848, orderProposalId#724875L, orderProposalHorizonGroupingId#724876L, splitIndicator#724903L, previousOrderProposal#724904L, clusterId#725273L, sequenceId#725276, avgItemsPerSequence#727285]
Arguments: createexternalrow(invoke(supplierGroup#724787.toString()), invoke(supplier#724788.toString()), invoke(plant#724789.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(deliveryDateTime#724790)), invoke(subrange#724791.toString()), invoke(supplyingPlant#724792.toString()), invoke(productGroup#724793.toString()), invoke(product#724840.toString()), static_invoke(DateTimeUtils.toJavaTimestamp(orderDateTime#724841)), static_invoke(DateTimeUtils.toJavaTimestamp(availabilityDateTime#724842)), static_invoke(DateTimeUtils.toJavaTimestamp(nextAvailabilityDateTime#724843)), invoke(mrpController#724844.toString()), invoke(sourceOfSupplyUuid#724845.toString()), invoke(purchasingOrg#724846.toString()), invoke(purchasingGroup#724847.toString()), static_invoke(java.lang.Boolean.valueOf(isFallbackOrderOnly#724848)), static_invoke(java.lang.Long.valueOf(orderProposalId#724875L)), static_invoke(java.lang.Long.valueOf(orderProposalHorizonGroupingId#724876L)), static_invoke(java.lang.Long.valueOf(splitIndicator#724903L)), static_invoke(java.lang.Long.valueOf(previousOrderProposal#724904L)), static_invoke(java.lang.Long.valueOf(clusterId#725273L)), static_invoke(java.lang.Integer.valueOf(sequenceId#725276)), static_invoke(java.lang.Double.valueOf(avgItemsPerSequence#727285)), StructField(supplierGroup,StringType,true), StructField(supplier,StringType,true), ... 21 more fields), obj#727336: org.apache.spark.sql.Row
(190) MapPartitions
Input [1]: [obj#727336]
Arguments: org.apache.spark.sql.internal.ToScalaUDF$$$Lambda/0x00000008021bcd18@2ec20285, obj#727361: org.apache.spark.sql.Row
(191) SerializeFromObject
Input [1]: [obj#727361]
Arguments: [if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(0))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 0, supplierGroup), StringType, ObjectType(class java.lang.String)))) AS supplierGroup#727386, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(1))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 1, supplier), StringType, ObjectType(class java.lang.String)))) AS supplier#727387, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(2))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 2, plant), StringType, ObjectType(class java.lang.String)))) AS plant#727388, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(3))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 3, deliveryDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS deliveryDateTime#727389, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(4))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 4, subrange), StringType, ObjectType(class java.lang.String)))) AS subrange#727390, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(5))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 5, supplyingPlant), StringType, ObjectType(class java.lang.String)))) AS supplyingPlant#727391, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(6))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 6, productGroup), StringType, ObjectType(class java.lang.String)))) AS productGroup#727392, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(7))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 7, product), StringType, ObjectType(class java.lang.String)))) AS product#727393, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(8))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 8, orderDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS orderDateTime#727394, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(9))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 9, availabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS availabilityDateTime#727395, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(10))) null else static_invoke(DateTimeUtils.fromJavaTimestamp(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 10, nextAvailabilityDateTime), TimestampType, ObjectType(class java.sql.Timestamp)))) AS nextAvailabilityDateTime#727396, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(11))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 11, mrpController), StringType, ObjectType(class java.lang.String)))) AS mrpController#727397, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(12))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 12, sourceOfSupplyUuid), StringType, ObjectType(class java.lang.String)))) AS sourceOfSupplyUuid#727398, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(13))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 13, purchasingOrg), StringType, ObjectType(class java.lang.String)))) AS purchasingOrg#727399, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(14))) null else static_invoke(UTF8String.fromString(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 14, purchasingGroup), StringType, ObjectType(class java.lang.String)))) AS purchasingGroup#727400, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(15))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 15, isFallbackOrderOnly), BooleanType, ObjectType(class java.lang.Boolean)).booleanValue()) AS isFallbackOrderOnly#727401, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 16, orderProposalId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalId#727402L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 17, orderProposalHorizonGroupingId), LongType, ObjectType(class java.lang.Long)).longValue())) AS orderProposalHorizonGroupingId#727403L, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 18, splitIndicator), LongType, ObjectType(class java.lang.Long)).longValue())) AS splitIndicator#727404L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(19))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 19, previousOrderProposal), LongType, ObjectType(class java.lang.Long)).longValue()) AS previousOrderProposal#727405L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(20))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 20, clusterId), LongType, ObjectType(class java.lang.Long)).longValue()) AS clusterId#727406L, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(21))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 21, sequenceId), IntegerType, ObjectType(class java.lang.Integer)).intValue()) AS sequenceId#727407, if (invoke(assertnotnull(input[0, org.apache.spark.sql.Row, true]).isNullAt(22))) null else invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 22, avgItemsPerSequence), DoubleType, ObjectType(class java.lang.Double)).doubleValue()) AS avgItemsPerSequence#727408, assertnotnull(invoke(validateexternaltype(getexternalrowfield(assertnotnull(input[0, org.apache.spark.sql.Row, true]), 23, binId), IntegerType, ObjectType(class java.lang.Integer)).intValue())) AS binId#727409]
(192) AdaptiveSparkPlan
Output [24]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, avgItemsPerSequence#727408, binId#727409]
Arguments: isFinalPlan=true
(193) TableCacheQueryStage
Output [23]: [availabilityDateTime#727395, binId#727409, clusterId#727406L, deliveryDateTime#727389, isFallbackOrderOnly#727401, mrpController#727397, nextAvailabilityDateTime#727396, orderDateTime#727394, orderProposalHorizonGroupingId#727403L, orderProposalId#727402L, plant#727388, previousOrderProposal#727405L, product#727393, productGroup#727392, purchasingGroup#727400, purchasingOrg#727399, sequenceId#727407, sourceOfSupplyUuid#727398, splitIndicator#727404L, subrange#727390, supplier#727387, supplierGroup#727386, supplyingPlant#727391]
Arguments: 0
(194) Project [codegen id : 1]
Output [24]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, concat(0, _, cast(binId#727409 as string), _, 10000002108) AS shardId#727860, monotonically_increasing_id() AS worklistShardItemId#727861L]
Input [23]: [availabilityDateTime#727395, binId#727409, clusterId#727406L, deliveryDateTime#727389, isFallbackOrderOnly#727401, mrpController#727397, nextAvailabilityDateTime#727396, orderDateTime#727394, orderProposalHorizonGroupingId#727403L, orderProposalId#727402L, plant#727388, previousOrderProposal#727405L, product#727393, productGroup#727392, purchasingGroup#727400, purchasingOrg#727399, sequenceId#727407, sourceOfSupplyUuid#727398, splitIndicator#727404L, subrange#727390, supplier#727387, supplierGroup#727386, supplyingPlant#727391]
(195) Project [codegen id : 1]
Output [26]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, shardId#727860, worklistShardItemId#727861L, null AS orderProposalItemGroupId#727862, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#727863]
Input [24]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, shardId#727860, worklistShardItemId#727861L]
(196) ResultQueryStage
Output [26]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, shardId#727860, worklistShardItemId#727861L, orderProposalItemGroupId#727862, orderProposalItemId#727863]
Arguments: 1
(197) Project
Output [24]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, concat(0, _, cast(binId#727409 as string), _, 10000002108) AS shardId#727860, monotonically_increasing_id() AS worklistShardItemId#727861L]
Input [23]: [availabilityDateTime#727395, binId#727409, clusterId#727406L, deliveryDateTime#727389, isFallbackOrderOnly#727401, mrpController#727397, nextAvailabilityDateTime#727396, orderDateTime#727394, orderProposalHorizonGroupingId#727403L, orderProposalId#727402L, plant#727388, previousOrderProposal#727405L, product#727393, productGroup#727392, purchasingGroup#727400, purchasingOrg#727399, sequenceId#727407, sourceOfSupplyUuid#727398, splitIndicator#727404L, subrange#727390, supplier#727387, supplierGroup#727386, supplyingPlant#727391]
(198) Project
Output [26]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, shardId#727860, worklistShardItemId#727861L, null AS orderProposalItemGroupId#727862, cast((monotonically_increasing_id() % 9999999999) as string) AS orderProposalItemId#727863]
Input [24]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, shardId#727860, worklistShardItemId#727861L]
(199) AdaptiveSparkPlan
Output [26]: [supplierGroup#727386, supplier#727387, plant#727388, deliveryDateTime#727389, subrange#727390, supplyingPlant#727391, productGroup#727392, product#727393, orderDateTime#727394, availabilityDateTime#727395, nextAvailabilityDateTime#727396, mrpController#727397, sourceOfSupplyUuid#727398, purchasingOrg#727399, purchasingGroup#727400, isFallbackOrderOnly#727401, orderProposalId#727402L, orderProposalHorizonGroupingId#727403L, splitIndicator#727404L, previousOrderProposal#727405L, clusterId#727406L, sequenceId#727407, shardId#727860, worklistShardItemId#727861L, orderProposalItemGroupId#727862, orderProposalItemId#727863]
Arguments: isFinalPlan=true
(200) TableCacheQueryStage
Output [2]: [sequenceId#727407, shardId#727860]
Arguments: 0
(201) HashAggregate [codegen id : 1]
Input [2]: [sequenceId#727407, shardId#727860]
Keys [1]: [shardId#727860]
Functions [1]: [partial_max(sequenceId#727407)]
Aggregate Attributes [1]: [max#730635]
Results [2]: [shardId#727860, max#730636]
(202) HashAggregate [codegen id : 1]
Input [2]: [shardId#727860, max#730636]
Keys [1]: [shardId#727860]
Functions [1]: [max(sequenceId#727407)]
Aggregate Attributes [1]: [max(sequenceId#727407)#730244]
Results [2]: [shardId#727860, max(sequenceId#727407)#730244 AS maxClusterSequenceId#730217]
(203) ResultQueryStage
Output [2]: [shardId#727860, maxClusterSequenceId#730217]
Arguments: 1
(204) HashAggregate
Input [2]: [sequenceId#727407, shardId#727860]
Keys [1]: [shardId#727860]
Functions [1]: [partial_max(sequenceId#727407)]
Aggregate Attributes [1]: [max#730635]
Results [2]: [shardId#727860, max#730636]
(205) HashAggregate
Input [2]: [shardId#727860, max#730636]
Keys [1]: [shardId#727860]
Functions [1]: [max(sequenceId#727407)]
Aggregate Attributes [1]: [max(sequenceId#727407)#730244]
Results [2]: [shardId#727860, max(sequenceId#727407)#730244 AS maxClusterSequenceId#730217]
(206) AdaptiveSparkPlan
Output [2]: [shardId#727860, maxClusterSequenceId#730217]
Arguments: isFinalPlan=true
| Name | Value |
|---|---|
| spark.activity.hdlfsEnabled | true |
| spark.activity.isolateSession | true |
| spark.sql.parquet.fieldId.read.enabled | true |
| spark.sql.parquet.fieldId.write.enabled | true |
| temporal.activity.id | 7538468d-5364-3382-88f1-3674ecb3dbd2 |
| temporal.activity.type | CreateOrderProposalShards |