According to one embodiment, the goods management device includes a carried out goods detecting portion that receives a reading result from a first wireless tag reader arranged in a depository storing goods attached with a wireless tag, and detects, based on the result, that the goods attached with tag data have been taken away from the depository; a user data receiving portion that receives, as a reading result, both of tag data, unique to a user, carried by the user who is taking away the goods and tag data attached to the goods being taken away from a second wireless tag reader arranged near a door, which is usually locked, of a building or a room in which the depository is installed; and an unlock direction portion that instructs unlocking of the door, only in a case where the tag data of the goods determined by the carried out goods detecting portion to have been taken away matches with the tag data attached to the goods being taken away and received by the user data receiving portion and where the tag data unique to the user belongs to the user who has a proper permission.