Yes, that lunch actually happened
In episode 3 of The Crown's new season, viewers play witness to the power play heard 'round the world. Loaded with awkwardness and passive-aggression, Camilla and Diana's not-so-friendly meeting goes down on screen at an almost too aptly-named restaurant called Menage A Trois, where Charles's ex and to-be mistress flexes on his future wife. While the exact situation has obviously been dramatized, it turns out that fateful lunch did indeed occur in real life (although nothing points to the location being so on-the-nose).
To Diana's knowledge, Camilla was just a friend of her fiancé's when the latter invited her to lunch one day. "It was during that meeting, arranged to coincide with Prince Charles’s trip to Australia and New Zealand, that Diana became suspicious," Royal writer Andrew Morton wrote in the book Diana: Her True Story – In Her Own Words. "Camilla kept asking if Diana was going to hunt when she moved to Highgrove." That part of the conversation is recreated on-screen, during which Camilla hints that Highgrove is her special spot with Charles.