Shortly after the deal was unveiled, Pope Francis recognised seven clergy appointed by Beijing, which has not had ties with the Vatican since 1951.
China immediately said it was hopeful of better relations, while Taiwan insisted its ties with the Vatican were safe.
There are an estimated 12 million Catholics in China, divided between a government-run association whose clergy are chosen by the Communist Party and an unofficial church which swears allegiance to the Vatican.
The Holy See is one of only 17 countries that recognise Taiwain, officially known as the Republic of China, instead of diplomatic ties with Beijing.
Pope Francis has sought to improve relations with China since he took office in 2013, but previous attempts foundered over Beijing's insistence that the Vatican give up recognition of its rival and promise not to interfere in domestic religious issues.
Saturday's breakthrough came as churches have been destroyed in some Chinese regions in recent months, and there has been a clampdown on Bible sales. Crosses have been removed from church tops, printed religious materials and holy items confiscated, and church-run kindergartens closed.
The agreement with China “concerns the nomination of Bishops, a question of
great importance for the life of the Church,” the Vatican said in a statement as Pope Francis began a visit to the Baltic states.
The deal “creates the conditions for greater collaboration at the bilateral level,” it added.
Following the announcement, the pontiff recognised seven bishops who had been ordained in China without the approval of the Holy See, his office announced.
“Pope Francis hopes that, with these decisions, a new process may begin that will allow the wounds of the past to be overcome, leading to the full communion of all Chinese Catholics,” a statement said.
The Taiwanese foreign ministry insisted Taipei would not lose its only diplomatic ally in Europe over the agreement, and said it hoped the Holy See would ensure that Catholics on the mainland “receive due protection and not be subject to repression”.
Taiwan's top China policy-making body, the Mainland Affairs Council, noted that religious communities in China still “suffer greatly” and urged Beijing to refrain from “interference and persecution.”
Analysts warn Beijing could use the accord to further crack down on Catholic faithful.
Jonathan Sullivan, director of the China Policy Institute at the University of Nottingham, described the accord as “a strategic move on China's part; and a naive one on the Vatican's”.
Sullivan said China's Communist party will frame the deal as the Vatican's seal of approval to the state-run Catholic Church at a time Christian believers are facing a severe crackdown.
“Ultimately, the Party would like to subsume all forms of worship under state organs that make it easier to manage and ensure that everyone's primary loyalty is to the state,” Sullivan told AFP.
A priest from an underground church in China's northern Hebei province said some of his flock had reservations.
“For the church members and priests, there are some that accept, and some that cannot completely understand (the situation), because they remain suspicious of the Communist Party and Chinese government. They doubt their sincerity,” the priest said on condition of anonymity.
Churchgoers in Beijing and Shanghai at Saturday evening services were generally unaware that a deal had been struck.
“Whatever this means for the church is up to God. As a follower of the church, we pray for the best,” said one, who gave her name only as Magdalene.
Please whitelist us to continue reading.