Schwimer created some controversy last season in Philadelphia when he openly criticized the organization for sending him to the Minors instead of being placed on the disabled list. Schwimer opted not to report to Triple-A Lehigh Valley and instead received a second opinion on his right bicep injury.
Charles, 22, hit .236 with seven home runs and 18 RBIs for Class A Vancouver last season. He was taken in the 33rd round of the 2008 Draft.
To make room on the 40-man roster for Schwimer, the Blue Jays added left-hander Luis Perez to the 60-day disabled list. Perez, who is coming off Tommy John surgery, is expected to be out until at least the All-Star break.