I've been troubleshooting this over the weekend and could not find any vacuum leaks. I wouldn't mind replacing the charge pipe coming from the turbo, but I don't think it's the culprit.
I replaced my PCV box because I was advised to do so for an unrelated issue. Because it was a service item and I didn't know when it was last done, if at all. But thinking back, I believe the idle issues began after replacing the PCV.
Now, when I was under the hood I noticed this little vent hole on top of the round PCV valve on the box.

With the car running I put my finger over this hole and it made the classic high pitched PCV sound -
I repeatedly blocked it off with my finger and released it once the high pitched noise would become present.
After repeating this process 7-8 times the noise disappeared and the idle returned to normal...
So, my conclusion is the diaphragm inside the PCV was stuck and not functioning correctly.
My symptoms were that of a failed PCV, but I wrote it off as the likely cause because it had only just been replaced. The V70 now has a smooth idle and I'm relatively confident the issue has been resolved.