Brazil's interim President Michel Temer looks on during a ceremony for inauguration of the new Minister of Culture, Marcelo Calero, at the Planalto Palace in Brasilia, Brazil, May 24, 2016. [Photo/Agencies]

RIO DE JANEIRO - Brazilian interim President Michel Temer, who had tried to impress voters with a capable Cabinet, is having a lot of headaches brought by his ministers.

Less than two weeks into office, Temer lost the minister of planning and budget, Romero Juca, who was caught on tape saying that the impeachment of President Dilma Rousseff was necessary to halt the investigations against state-owned oil company Petrobras and other sectors.

Juca announced that he was taking a leave of absence within hours after the recording was released on Monday.

Temer took over from Rousseff after she was suspended as part of the impeachment proceedings.

The recorded conversations added evidence to what Rousseff had repeatedly said -- the impeachment was a strategy to halt corruption investigations.

Moreover, Education Minister Jose Mendonca Filho was severely criticized on Wednesday for holding a meeting with a porn actor and confessed rapist.

Health Minister Ricardo Barros was also under fire for remarks that Brazil's public healthcare needs to be scaled down.

Several anti-Temer protests have been held in the past two weeks, posing a severe challenge to the new administration.