White, 50, requested the release from the last two years of his contract, citing disappointment over missing out on the position as Wallabies coach to Ewen McKenzie.
Former Springbok coach White helped the Brumbies reach this year's Super Rugby final.
The Brumbies are yet to announce who will replace White, although Brumbies backs coach Stephen Larkham is the favourite.
‘‘The Brumbies are a great team and I have thoroughly enjoyed my time with the players, the coaches, fans, the board and sponsors,’’ White said in a statement released by his management.
White will return to South African rugby as Director of Coaching at the Sharks, a report on Die Burger's website indicates.