Two diplomats at the Russian Embassy had engaged in acts that are incompatible with their diplomatic status and two at the permanent mission to the UN in Vienna committed acts incompatible with the Headquarters Agreement, according to the Foreign Ministry. It didn't elaborate.
The diplomats were given a week to leave Austria.
Since Moscow's full-scale invasion of Ukraine started nearly a year ago, Western European nations and Russia have expelled each other on several occasions.
Austria, a member of the European Union that has a policy of military neutrality, has given aid to Ukraine but not military equipment. President Alexander Van der Bellen was in Kyiv on Wednesday on a trip meant to underline Austria's solidarity.
Vienna is home to U.N. agencies, including the International Atomic Energy Agency and the U.N. Office on Drugs and CrimeU.N. Office on Drugs and Crime.
The Russian Foreign Ministry said it would respond in kind to the diplomats expulsion, according to state news agency Tass.
Russian ambassador to Austria Dmitry Lyubinsky said in televised remarks that he and Mikhail Ulyanov, ambassador to international organizations in Vienna, visited the Austrian Foreign Ministry late Wednesday night to hear about the decision.
He said that we voiced a resolute protest, rejected the unfounded allegations and warned about the inevitability of retaliatory measures.
Lyubinsky said Austrian authorities failed to make specific accusations beyond unfounded claims and vague references to the opinion of special services and that the decision would affect Austria's position as a neutral international platform for negotiations.