Despite a poor record against the Boks, the New Zealand-born coach is confident that they can turn the tables over the next two weeks.
In an interview with the Wales Online website, Gatland said his main target for the tour is to win.
He referred back to their last visit to South Africa in 2008. South Africa won the first Test 43-17 in Bloemfontein and then 37-21 the following week in Pretoria.
Gatland felt Wales had their chances in that second Test though, but said a couple of calls went against them which proved costly.
He said it would be imperative that they start well this time round to "hopefully win", insisting they are not in South Africa "merely to make up the numbers".
Wales' overall record against South Africa is woeful though. The Boks hold a 25-1 winning record, with one match ending in a draw.
In the teams' last outing - in Cardiff last November - South Africa won 24-15.
Wales will face the EP Kings in Port Elizabeth on Tuesday night, before tackling the Boks in back-to-back Tests (Durban, June 14 and Nelspruit, June 21).