It depends on how you want it to be perceived, I feel.
If you're speaking quantifiably, like a literal half of you, then, yes, I would go with: "Только половина меня".
If you're speaking intangibly about your own being and/or soul, then I would decide to go with: "Просто половина меня." "Просто" implies a sort of "simply".