José Caballero had two hits and two RBIs and the Tampa Bay Rays scored all their runs in the second inning before holding on for a 4-3 win over the Chicago White Sox on Tuesday night.