Magnesium hydroxide is an alkaline hydroxide that is insoluble in alkali, while aluminum hydroxide is an amphoteric hydroxide that is soluble in alkali.
So use a strong alkaline solution to distinguish between the two, and put them into a sodium hydroxide solution. The dissolved one is aluminum hydroxide, while the insoluble one is magnesium hydroxide