As long as the chambers and runners are close to the same size, you'll be fine.
Every single person I know that built up a 305 regretted it. For the cost of a block, you can upgrade to a 350 block and even stroke it if you like.
It's not just the cubic inches that's a problem, it's the small...