Following the attacks on Monday in Mangu district, "85 bodies [were] recovered," the chairman of the local government council Daput Minister Daniel told media.
He said some people were wounded, without giving a number, while "several houses have been destroyed and many people are now displaced."
The State Emergency Management Agency (SEMA) also said "thousands of people were moving on the road" following the attacks.
The region lies on the dividing line between Nigeria's mostly Muslim north and mainly Christian south and has for years struggled with ethnic and religious violence.
It was unclear what prompted the latest violence, but tit-for-tat killings between herders and farmers often spiral into raids on villages by heavily armed gangs.
Juni Bala, director of search and rescue at SEMA, said their team visited the area on Wednesday.
"We could see houses that were still burning," Bala told media. "We couldn't go further because [he] youth were angry."
Police said on Thursday that they had arrested five people in connection with the violence.
"Heavy security presence has been deployed," police spokesman Alfred Alabo said in a statement. "So far calm has been restored to the general area of Mangu Local Government [Area] while monitoring continues."