The ceremony was attended by several South Asian and Southeast Asian leaders as part of Modi's effort to build economic partnerships in the region.
Modi on Thursday sworn in as the prime minister for a second term, heading the National Democratic Alliance government, in the presence of a large gathering of national and global dignitaries.
However, Pakistan prime minister Imran Khan has not been invited this time around.
Last time, Modi had invited all SAARC leaders - including the then-Prime Minister of Pakistan Nawaz Sharif and then-Sri Lanka President Mahinda Rajapaksa, both of whom had come to his oath-taking ceremony.
While the guests attending the event will be treated to high tea, President Ram Nath Kovind will host a private dinner for the leaders from Bimstec countries as well as Kyrgyz President Sooronbay Jeenbekov and Mauritian Prime Minister Pravind Kumar Jugnauth - who have all confirmed their presence.
Outgoing foreign minister Sushma Swaraj was not among the group to take the oath, meaning she would also be replaced.
Modi is likely to hold bilateral meetings with most of the worldwide leaders on 31 May. Madhur Verma, DCP, told ANI they have put in three-layer security arrangements in place for the swearing-in ceremony, "The first layer is of VIP security as well as Rashtrapati Bhawan, followed by a layer of Delhi Police". However, West Bengal chief minister Mamata Banerjee, Odisha chief minister Naveen Patnaik, Chhattisgarh chief minister Bhupesh Singh Bhaghel and Kerala chief minister Pinarayi Vijayan have expressed inability to attend the event. This is believed to be one of the largest gatherings for a single event when the Prime Minister and his Council of Ministers will take the oath for a second term.
The portfolios of the Cabinet ministers were expected to be announced later Thursday.
Opposition leader Rahul Gandhi, whose Congress party suffered a second straight humiliating defeat, was among the crowd with his mother Sonia, the former Congress leader. While worldwide tycoons John Chambers and Bill Gates have also been extended invitation. Shah was also greeted with loud cheers.