I love to go for walks.

Slightly more idiomatic: I love going for walks

I often stroll around my town without a destination and stop by cafes or general stores.

You could also say, "I often stroll around my town aimlessly," or, "I often wander around town"

My house is nearby the sea, so I often also take a walk s along the sea shore.

"Nearby" is used alone (my house is nearby) whereas "near" is used when referencing the distance of two specified locations (my house, the sea)

We use "along" when speaking about remaining close to an "edge" or guided path. A wall, shore, river, street, train tracks, etc.

I can find out newdiscover new things during each walking.

The original line would be hard to understand, but I think this would capture your meaning.