You have a number of SSI Script functions that can assist here ...
So for example, if you have Q1 as your numeric question and you want to skip Q2 if they did answer Q1, you could use this in your skip logic at Q2 ...
Select a pre-skip
Set the skip-to question to Q3
You can also use values at Q1 in your skip logic like Q1>0 for example.