Victoria’s opposition has stopped short of promising to force the state’s public service back to the office five days a week.