This is satisfying

In my personal experience, and from what I've seen from other devs, turning expressive toys like this into satisfying games is very tricky. Look at something like Fract OSC. It was a great musical toy with aspirations of being a game that won an IGF award in 2011. It took them three years to figure out how to make it into a game, and they ended up with a mediocre Myst-like that occasionally had you playing with a great musical toy. That's usually how they end up -- either they lose what made the toy great, or the toy ends up something you play with while also playing a game.

I'm not saying don't go for it, but I am saying don't feel bad if you fail. You still made a fun satisfying toy, and it doesn't need to be anything else.