Siding gets dirty - especially under the eaves.  Many homes get little black spots on the north side.  This is mildew and it is normal for this area, especially in shady regions.  If you or your neighbor just put in a new lawn, dirt and grim can collect on the exterior of your house, making it filthy.  The lighter the color of your siding, the more it shows the dirt!