Cash's World Server

[sorcerykid]

Hey 843, just checking in to see if things are okay. Any luck with the filesystem change?

[843jdc]

My IP address depends on how I am connected to my cable modem. Each port of my cable modem (4 wired + 4 wireless, 8 total allowed) has a different global IP address.

I was recently using wireless due to a bad Ethernet cable, which is now fixed, and somehow the virtual machine's IP address was being set by the cable modem and it occasionally changed! I think due to RFI (interference).

I will now switch back to using my wired connection. Then go back to solving the IP address changes and port sharing problems.

I'll bring the server up regardless in a couple of hours so the kids have a place to play this weekend. Though I might still have some problems. I noticed JT2 not on the server list yesterday. Was it down? Not good for them having 2 popular servers down at once.

I contacted a 'suit' at my local ISP about swapping a higher outgoing speed for less incoming speed. He needs time to look into it. I am residential not business. It's the weekend here already so this might not be resolved until next week. If he can't do it, nobody can. Except maybe the CEO. He's next if needed. /me looks in closet to check the condition of my suit. No moth holes. haha xD

If I can get what I want, I will be able to double my player load. Regardless, the server eats up all of my outgoing speed when a player connects so I will have to start throttling it a bit.

[843jdc]

The server has been running in a virtual machine that was placed on its own hard disk drive. For some reason the map file got corrupted. I restored from backup and the same problem reoccurred.

The corrupt map could be caused by a number of things. I will erase the disk drive that I want to use for the virtual machine and start all over. I'll make a few changes in how the server runs in the virtual machine and hope that solves the problem.

The server is now running like it used to but is using a week-old map, 30 Dec 2016.

It could be worse. I could have done all this and not told anyone. I've had that happen a number of times on other servers. I'd get so mad that I'd quit playing and swear never to go back! But I always did and rebuilt :)

[Wraz]

ADMIN killer #1 XD

[843jdc]

That time. Maybe not the next time.

[BBmine]

ADMIN killer #1 XD

Oh, welcome to the forum, Wraz :3. Why you mad about ADMIN killing? We were a gang, right? :P

[PurpleOne]

Screenshot_2017-01-24-20-48-12.png (290.55 KiB) Viewed 3549 times

[BBmine]

Screenshot_2017-01-24-20-48-12.png

What about that? You like the travelnet? XD

[843jdc]

RE: PurpleOne

So only seven destinations can be seen.
Thank you xD

Because of excessive lag, the server is shut down while I do a back up. I will do daily backups for 1-2 weeks while the server is in the virtual machine. I don't want any more corrupted maps causing everyone to lose a lot of work.

The back up is going slowly. I am also seeing problems with file names for player files. I didn't know Windows NTFS filesystem was case-insensitive as it seems to be. So some payers will not have their player files backed up. When I first read about Virtual Machines, they were advertised as being a great thing. I am learning that they don't live up to all the hype. I wish I could find a Type-1 hypervisor that would allow me to run Windows, Linux and DOS and that was 'free'.

I am increasing the number of CPUs allocated to the VM from 1 to 2.

Backup is 25% complete after about 10 minutes. This is gonna take a while :( Too many player files haha

[BBmine]

RE: PurpleOne

So only seven destinations can be seen.
Thank you xD

Because of excessive lag, the server is shut down while I do a back up. I will do daily backups for 1-2 weeks while the server is in the virtual machine. I don't want any more corrupted maps causing everyone to lose a lot of work.

The back up is going slowly. I am also seeing problems with file names for player files. I didn't know Windows NTFS filesystem was case-insensitive as it seems to be. So some payers will not have their player files backed up. When I first read about Virtual Machines, they were advertised as being a great thing. I am learning that they don't live up to all the hype. I wish I could find a Type-1 hypervisor that would allow me to run Windows, Linux and DOS and that was 'free'.

I am increasing the number of CPUs allocated to the VM from 1 to 2.

Backup is 25% complete after about 10 minutes. This is gonna take a while :( Too many player files haha

You should do daily backups all the time. What if your hard drive crashes or a griefer like CleanerPro ruins the world?

[sorcerykid]

Hi 843, sorry to hear about your troubles. How are you performing your daily backups?

For JT2 server, I just create a tarball. Here's an excerpt from my backup script that I have scheduled in crontab:

Your phone or window isn't wide enough to display the code box. If it's a phone, try rotating it to landscape mode.

Code: Select all

rm ~/backups/dailies/*
cd /tmp/worlds/jt2
tar -czvf ~/backups/dailies/players.tar.gz auth.txt skins.mt players
tar -czvf ~/backups/dailies/map.tar.gz map.sqlite map_meta.txt env_meta.txt


By archiving everything into a single file, case sensitivity, permissions, timestamps, and other filesystem-specific attributes are preserved. Hope you get everything sorted out.

[BBmine]

Here's my code:

Your phone or window isn't wide enough to display the code box. If it's a phone, try rotating it to landscape mode.

Code: Select all

if [ $(date +"%H") = 0 ]
then tar -cvzf /media/b55acd7c-30a2-4689-96f3-ec796b9dce7a/BBmine/Backup/worlds/Noob_Academy/Noob_Academy_$(date +"%Y-%m-%d").tar.gz .minetest/worlds/Noob_Academy/
fi

Hope this helps :)

[Wraz]

Server not available.
Please, move me and Rita to 0,32,0.
Rita found strange place on map. When someone in this place - server crashes. See my coords in player files

[843jdc]

{Emerge-0}: zerr: invalid or incomplete deflate data
ERROR{Emerge-0}: Invalid block data in database (-181,0,-233) (SerializationError): decomplressZlib: inflate failed

Two seconds later:

ERROR[Main}: Invalid data in MapBlock (-181,0,-233)
ERROR[Main: ----
ERROR[Main: "Invalid block data in database"
ERROR[Main: See debug.txt.
ERROR[Main: You can ignore this using [ignore_world_load_errors = true].

Just terrific.

Rita was laying blocks at the road near -2922,7.-3779

Wrazhevsky was there experimenting.
I'll look at the logs then bring the server back up and see what happens

[843jdc]

I've done some reading after a Google search. From what I can see, this error has persisted for at least 3-4 years across various versions of MineTest. The usual 'solution' is to claim that the map is corrupt and for the admin to wipe the current map, reinstall from backup, or a bad hard drive.

The server is down until I run a read-write test of the hard drive. And while I try to remember if the first time this happened to me was while using this HDD or another one.

Though I have a suspicion that the problem might be caused by dropped UDP packets.

This test might take several hours. Sorry.

[Wraz]

All correct, mapblock size is 16 in any dimension. -181*16 ~-2922; -233*16 ~ -3779
Try to remove MapBlock (-181,0,-233) if this possible and testing hard disk has no result.

[843jdc]

Ah. * 16. Thanks for that info. I remember seeing it somewhere in the forums and was going to have to search for it.

I TPed to that area. I TPed high. Then flew down. The server didn't start crashing again until I dug some sand near the road. Then the server repeatedly crashed when I logged in. I had to edit my player file to move me away from there.

I rebooted into Linux so I could use smartmodtools. It shows no errors for that drive. It does show errors on my main drive though :( Not the SSD fortunately.

I am testing that drive anyway since the server is down. Testing that 320GB HDD is taking a long time as expected.

If it passes the test, and I think it will, I will restart the server using a day-old map and TP to that area to verify that the map is ok. I will run the server in the virtual machine using Linux as the host and not Windows. I want to see if the map goes bad in that situation.

Gesh, this is a long wait. Can we somehow fit MT onto an old 540MB HDD? Testing that was much faster :) I remember thinking when I bought it that I would never fill it up. ha!

[843jdc]

The drive tested fine. The server is up. There seems to be no problems in the area that Wraz and Rita were in. I dug the road without problems.

Let's see what happens.

[BBmine]

Glad to see it's up and good now!! See? That's why I make daily backups on my server. :D

My laptop's hard drive had about 1,000 errors one time. Now it has 0. :)

[843jdc]

Server is a bit laggy. I think I will take a crack at installing and using Redis for the database backend tonight.

[843jdc]

Server is down to change mods and install redis. This is gonna take longer than 20 minutes :/

[BBmine]

Server is down to change mods and install redis. This is gonna take longer than 20 minutes :/

You can actually change mods while the server's up, as long as you have a script to restart it every day. Mine restarts at noon and midnight every day, so I can change the mods any time, and it'll go into effect at restart. Just a suggestion to keep from having to turn off the server so much :)

[843jdc]

Duh. What I am doing is more complicated than that.

[843jdc]

redis installed
libhiresdis installed
New server compiled against libhiredis
minetestserver renamed to minetestserver-redis to preserve the old executable just in case.
redis_address & redis_hash set in world.mt
./minetestserver-redis --verbose --migrate redis --world ../../WORLDS/cashs_world executed
--verbose is needed else I think nothing is happening for a long time because system monitor does not show the server process as using much cpu or memory.
Waiting for the 5.6GB map to be converted

This msg is for status, to tell any interested people how I did it, to tell me how I did it in case I need to do this again.

/me watches NetFlix while waiting for the conversion to finish
Failed to load block -41,-262,-7 = -656, -4192, -112
50% complete

[PurpleOne]

/me waits patiently wishing she had Netfix as well

I knew it was going to take longer than 20 minutes. But then again you can never really judge the time it takes to do anything on computers. They take their precious time xD

[maikerumine]

Duh. What I am doing is more complicated than that.

LOLOLOL
Great response, 843!

[BBmine]

Duh. What I am doing is more complicated than that.

LOLOLOL
Great response, 843!

What

is

that

guy

with his teeth falling out doing :P

[Wraz]

still down :/

[843jdc]

I have finally tried to do something on my computer that it can't easily do with 16GB of RAM: running a virtual machine and using redis! Oh well.

The map was 70 % converted when suddenly the memory usage of the virtual machine maxed out and the conversion process entered an endless loop. I gave the VM more memory and started again. Sometime later, the VM crashed. I gave up and took a break.

The map has been copied out of the VM so I could use the host OS to convert the map. There were a number of 'failed to load block' messages during the conversion. I assume those are corrupt sections of the map that redis could not read. I then started the server and inspected each of those areas.

Most of those areas are either in the air or underground. A few are in developed areas, tipo, PurpleOne, Jasmine built there. I assume mapgen rebuilt those areas when I TPed there. From what I can see, what was built by players is ok. Though I see dirt_with_snow where I wouldn't expect a player to place dirt.

Testing has NOT been done to determine if the bad areas were caused by using a VM or from some time before. I'm really not that interested in spending more hours doing that.

I now need to copy the redis file to the virtual machine. Then restart the server.

As I said, the map is backed up from before I installed redis. From here on out, we get to test how well MineTest with redis works in my VM xD. Cross your fingers folks!

For those interested:
1 - The redis file is about half of the size of the SQLite map file.
2 - The conversion from SQLite to redis took at least 2 hours to reach 70% converted in the VM.
3 - When converted 'normally' (not in the VM) the conversion was completed in about 10 minutes!
The VM had 8GB and 2 cpu cores allocated to it also. Puzzle that one out!

Where to run the redis server is a question to be answered. In the VM or in the host? Host might be faster. For now, I will leave it in the VM and see how it works.

The server should be up soon. Though I do want to see about giving the VM a larger virtual HDD.

[PurpleOne]

Corrupt areas? Yay!! (sarcastic) ill have to go on a hunt to see what corruption your talking about.Not sure where It's at. I own a lot of area. Hope it's nothing too serious. Ill just have wait for the server to get back up.