Mar 20, 2022
I ran into a similar issue, no other solution but to process the DELETE before the MERGE statement using 2 dataframes. Honestly, I also favor Delta Lake for the same reason.
Written by Manoj Kukreja
Author, Big Data Engineering, Data Science, Data Lakes, Cloud Computing and IT security specialist.