Remove older version of Java - Yea

From Here: http://www.java.com/en/download/faq/remove_olderversions.xml

Windows 7 and Vista - Uninstall Programs
1.Click Start
2.Select Control Panel
3.Select Programs
4.Click Programs and Features
5.Select the program you want to uninstall by clicking on it, and then click the Uninstall button.
You may need administrator privileges to remove programs.

Windows XP - Uninstall Programs
1.Click Start
2.Select Control Panel
3.Click the Add/Remove Programs control panel icon
4.The Add/Remove control panel displays a list of software on your system, including any Java software products that are on your computer. Select any that you want to uninstall by clicking on it, and then click the Remove button.