You aren't watering it enough. Watering in the pot every few days would work good, but it also helps with humidity to spray the foliage with water. The spathe with the bumpy things is most likely a male flower structure.

Thanks for your reply! Is the male flower structure dangerous or should it be removed? I will start watering more often! What should I do with the leaves that have brown tips? Pull them off or leave them be? Thanks again :)

Only to a female plant that doesn't want to propagate:-) If you bought a clustering plant, you may not know for sure if it is a clustering single plant, or several seedlings planted in the same pot to make it full out faster. You may have male and female plants that can make you seeds sometime.

The main rule on palms is never remove leaves that have green in them. Palms use up the nutrients in old leaves, so if they have green in them, you are making a healthier palm. If you just don't like the brown, and want to take the time and effort, you can trim just the brown parts off. Many interiorscape people do that to keep them looking good. You see that all the time with Rhapis palms in malls all the time.