It said that holding the Games without spectators was the “least risky” option and the desirable one.
However, the experts also floated an option that Olympic venues could each hold up to 10,000 spectators.
The president of Japan’s organising committee, Seiko Hashimoto, agreed that a “no fans” approach would reduce infections.
But she added that she would still explore ways to allow spectators.
The final decision is expected on Monday.
In a separate development on Friday, officials and volunteers working on the Games started receiving vaccinations.
Pfizer are providing enough doses for 40,000 people, in an effort separate to Japan’s national vaccination drive.
The Olympics are scheduled to go ahead despite a fresh wave of Covid-19 cases in Japan in recent months.
A state of emergency in Tokyo is set to be lifted on Sunday, but polls in local media suggest public scepticism to the Games going ahead remains high amid a slow vaccine roll-out.
Only about 16 percent of the country’s population have received one Covid-19 dose so far, according to Reuters news agency.
The vaccine doses allocated for Games officials have been supplied by Pfizer as part of a deal agreed with the International Olympic Committee and the Japanese government.
Those being vaccinated include volunteers and staff working at the athletes village and members of the media covering the Games.
“Now that I will be vaccinated, I will feel a little more reassured doing my job,” Chika Hirai, director of doping control for Tokyo 2020, was quoted by the AFP news agency as saying.