Jews are questioning their future in Australia

Executive Council of Australian Jewry co-chief executive Alex Ryvchin says there's a lot of anger in the Jewish community and the prime minister needs to act decisively.

"There's a sense that we, as a society, and particularly the federal government, have allowed this to occur, that the government has presided over the most steep increase in anti-Semitism in Australian history," he told reporters on Wednesday.

Mr Ryvchin said a lot of difficult conversations were taking place in the community as people questioned their place in society following a spate of attacks.

"They're questioning their future in Australia. They're feeling more safe abroad than they are in this country," he said.

The prime minister said he was briefed the morning after the arson attack by federal police, responded on radio and via a statement, and spoke to local Jewish community leaders as well as the local federal MP for the area.

The government was working behind the scenes in the days after to ensure security funding was available for the community, Mr Albanese said.

"Australians are respectful people. Australians want to live peacefully, side by side, and Australians reject this abhorrent criminal behaviour," he told ABC radio on Wednesday.

"This is not a political act.

"This does not change anything that is occurring on the ground in the Middle East, this is an attack against their fellow Australians."

Mr Albanese visited the synagogue on Tuesday, four days after the attack, when he promised to support its rebuild, but was jeered by some angry people over his handling of the situation.

As he was leaving a woman called out: "Your words are cheap and late", and "You are late. You let this happen, buddy".

The damage caused by the firebombing of the Adass Israel Synagogue. (Yumi Rosenbaum/AAP PHOTOS)

Another asked if he was "going to the Australian Open", referring to Mr Albanese playing tennis at the weekend.

Government minister Clare O'Neil also visited the site on Tuesday, after Mr Albanese left, and spoke to community members.

She said the angry reaction to the prime minister's visit was not universal and some hecklers were not locals.

"People were grateful that the prime minister was there, they were pleased to have him there and of course to see him make that commitment to help rebuild the synagogue," she told Seven's Sunrise program.

Yumi Rosenbaum, whose family have been in the synagogue's congregation for three generations, said community members had already made attempts to practise their faith since the attack.

The congregation of the Adass Israel Synagogue have vowed to rebuild after an arson attack. (Con Chronis/AAP PHOTOS)

"We're resilient people, we're not the type to get too down and we don't give up easily," he told AAP.

Mr Rosenbaum said Adass Israel members had been allowed to use a nearby school's synagogue.

A full reconstruction of the destroyed synagogue could take several years despite an outpouring of community donations and government funding.

Mr Albanese has committed to providing support for the synagogue's rebuild and funding for the restoration or replacement of scrolls damaged in the fire.

Victoria's government announced that 15 community organisations would receive $950,000 in security funding.

Floral tributes were laid at the Adass Israel Synagogue after the firebombing. (Joel Carrett/AAP PHOTOS)

Grants of up to $200,000 were available to Jewish community organisations to support the purchase, installation or improvement of security equipment at community facilities.

Three people are on the run following the arson after it was declared a likely terror attack on Monday, with investigators from Victoria Police, Australian Federal Police and spy agency ASIO leading the probe.