Welcome to /a/ and about half of anime fans in general regardless of whether they will admit it, because it is a big social taboo, but it is not illegal. You find something appealing about the loli. The executive branch HAET loli and will automatically associate it with pedophilia, which is many time just not the case. I love loli, but IRL lolis aren't appealing to me at all, they are completely different. IRL I'd rather have a healthy girl near my age, but in anime I like the lolis, and this isn't a problem.
Originally I felt the same as you, like I was a bad person. You aren't a bad or evil person for liking drawings and depictions of young girls.
If I have to be serious cat for a second here, try to find out if you are pedo IRL. When I explored this and realized 3d little girls don't have any type of moe or typical loli traits and I was definitely not attracted to them, it was a lot easier of a pill to swallow. Even if you ARE pedo, that is just fine too, as long as you understand what the law says you can and cannot do. If you are simply attracted to anime lolicon, that's just easy. So are half of people who watch anime. It is not evil to look at drawings which were not made from real CP. It is odd and can be considered deviant, but it is simply not "wrong" or "evil," just different. If you turn out to be a pedo IRL, just keep it to yourself.