Reports suggested Brown would be offered the job after Worthington decided to stand down following the team's failure to qualify for Euro 2012.
But Brown has quashed the speculation by telling the Evening Express: "The story is complete and utter rubbish."
IFA president Jim Shaw admitted that Motherwell skipper Stephen Craigan is on the shortlist which is also believed to include Martin O'Neill, Jim Magilton and Iain Dowie.
"Stephen Craigan is in the mix and we won't be ruling anyone in or out at this stage," Shaw told the Daily Record.
Source: Team Talk