What they're saying: "After discussions with the Vice President and administration officials this week, the federal government has agreed to my demand and will withdraw these officers from Portland".
Protesters filled the streets again into the early hours Tuesday, gathering for the 60th night on the city block where the courthouse is located.
The agreement also calls for the US government to clean the graffiti off the courthouse, which is federal property.
"As I told the Governor yesterday, federal law enforcement will remain in Portland until the violent activity toward our federal facilities ends".
Trump and administration officials have made clear that violent criminal activity will not be tolerated but that they prefer local and state leaders step forward to police their communities, as opposed to federal forces, Wolf said on Wednesday.
On the same day, US Attorney Billy J Williams insisted that the agents will remain as long as protesters keep attacking the Mark O Hatfield Federal Courthouse.
"The local Oregon officers of the Oregon State Police will provide protection for free speech and the security of the exterior of the courthouse with the Federal Protective Service", Brown said.
President Trump has defended the administration's response to the unrest in Portland and launched a separate initiative through the Justice Department to send officers to other US cities experiencing an uptick in violent crime, despite objections from their leaders.
Acting Homeland Security Deputy Secretary Ken Cuccinelli reiterated to CNN's Jake Tapper later Wednesday that some federal officers will remain in Portland to protect the courthouse, adding that other officers will also be in the city in case they're needed.
Thousands now gather nightly in Portland, and similar protests have been reinvigorated in other cities.
Like many other protests nationwide touched off by the killing of George Floyd at the hands of Minneapolis police, the Portland demonstrations sought to highlight and call for an end to racial injustice, but they had increasingly focused on federal property even before the USA agents arrived.
As the night progresses most protesters leave but a core group remains and grows more confrontational.
Brown and Portland Mayor Ted Wheeler, both Democrats, complained they never asked for the federal officers and their presence was worsening the situation with protesters.
He said there are protests in other cities but additional federal officers haven't had to be deployed because local police have responded - which he said is how it's supposed to work.
They were sent to the city by the Department of Homeland Security as part of President Donald Trump's crackdown on the defacement of federal property, statues and monuments.
Federal officers close a street as they move toward protesters during a demonstration in Portland, Ore., on July 29, 2020.