mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
Mark Smith ([staff profile] mark) wrote in [site community profile] dw_maintenance2011-12-21 11:41 am
  • Add Memory
  • Share This Entry

Adding a webserver

Hi all,

Dreamwidth is seeing some extra traffic today, so we're rolling out a new webserver to handle the extra load. We'll be paying close attention to the system load though and will be doing what we can to make sure everything is speedy and working.

Also, today I am joined by my infant son Oliver, who is helping me with the servers. Hello from Mark and Oliver!
Flat | Top-Level Comments Only
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2011-12-21 10:17 pm (UTC)(link)
If you have a large number (hundreds of thousands) of entries or comments, it can take a while to move them over -- how many entries and comments are in the account?
tabaqui: (Default)

[personal profile] tabaqui 2011-12-21 10:20 pm (UTC)(link)
Not as many as all that! Heh.

638 Journal Entries, 50 Tags, 241 Memories, <10 ScrapBook Files, 97 Virtual Gifts, 266 Userpics

Aaaaaand....

Profile data Waiting for verification to finish created 8 hours ago
Journal comments Waiting for entries to finish created 8 hours ago
Journal entries Waiting for tags and groups to finish created 8 hours ago
Custom security groups Waiting for verification to finish created 8 hours ago
Friends Waiting for groups to finish created 8 hours ago
Tags Waiting for verification to finish created 8 hours ago
Verifying username/password Ready to be entered into the queue created 8 hours ago

So, yeah, i'm just wondering if all the traffic today is what's making it take so long, or if i did something weird or.....what. Thanks for the quick reply!
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2011-12-21 10:21 pm (UTC)(link)
gotcha. possibly related to adding the new webserver; I've poked Mark and he'll take a look once he's done wrangling the kidlet. :)
tabaqui: (Default)

[personal profile] tabaqui 2011-12-21 10:22 pm (UTC)(link)
Heeee. I appreciate it. I mean - lots of traffic, it'll take a day, no big deal, but if i did something wrong or whatever, i just wanna fix it as soon as i can.

Thanks!
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2011-12-21 11:24 pm (UTC)(link)
And, we have figured out the reason and kicked the queue. Thanks for helping us troubleshoot!
tabaqui: (Default)

[personal profile] tabaqui 2011-12-21 11:41 pm (UTC)(link)
Awesome, thank you! I'm glad my flailing helped. :)
tabaqui: (Default)

[personal profile] tabaqui 2011-12-21 11:42 pm (UTC)(link)
Oh um - it said my import was aborted. So - i'll try again, but just thought you should know.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2011-12-21 11:47 pm (UTC)(link)
Did you have a previous import running? Possibly you are runniing into the weird thing (that we are trying to make clearer) where if you have an import in the queue already, then start a new one, the new one shows as 'aborted' while the previous one is still running. If you didn't get a failure in your DW inbox, it's still chugging along.
tabaqui: (Default)

[personal profile] tabaqui 2011-12-22 12:25 am (UTC)(link)
No, i didn't have one running other than that one. I think what happened is that i typed my password wrong. Thanks, though. :)
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2011-12-22 12:31 am (UTC)(link)
Ah! Yeah, that would do it. *G*
tabaqui: (s&doutsidebylierina)

[personal profile] tabaqui 2011-12-22 12:43 am (UTC)(link)
Whoooooo! Yup, that was the issue. Now we're all green. :)
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2011-12-22 12:46 am (UTC)(link)
Awesome \o/
tabaqui: (Default)

[personal profile] tabaqui 2011-12-22 05:16 pm (UTC)(link)
Hey, it's me again. I hate to bother you, but i have another question. My 'inbox' messages say that my friends, friends groups, bio, and tags have been successfully imported.

The other two say: Journal comments Waiting for entries to finish created 16 hours ago

Journal entries Waiting in the queue as of 16 hours ago

Is there any way to know how long the queue is or how long those will be 'waiting'? And can i make a post to either journal while this is going on?

Sorry to be so hover-y. I appreciate any help.
mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)

[staff profile] mark 2011-12-22 05:18 pm (UTC)(link)
The queue is currently 18 hours behind, so yours should be done in a few hours!
tabaqui: (Default)

[personal profile] tabaqui 2011-12-22 05:26 pm (UTC)(link)
Okay, that's good to know! Thanks!

Can i post to either journal right now, or will that mess things up?

mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)

[staff profile] mark 2011-12-22 05:34 pm (UTC)(link)
You can post! The importer is pretty smart and it will only bring over content from the remote site, it won't harm content you've added to your account.
tabaqui: (Default)

[personal profile] tabaqui 2011-12-22 05:37 pm (UTC)(link)
Cool, okay. Good to know!
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2011-12-22 06:40 pm (UTC)(link)
You're fine! The queue is very long right now, which always happens whenever there's a surge in registration like this, and it will almost certainly take a while -- depending on where in the queue you are, it may take a few days. You can keep using your journals normally (posting, commenting, etc) and then eventually you will get a message in your inbox saying that your entries are there and it will be like magic! and then a little while later you will get a message saying that your comments are there and it will be like magic! :)

EDIT: hee hee hee, you can tell that I answer my comments in the order they hit my inbox without reading ahead. SORRY FOR THE DOUBLE ANSWER
Edited 2011-12-22 18:41 (UTC)
tabaqui: (Default)

[personal profile] tabaqui 2011-12-22 06:42 pm (UTC)(link)
Heeee!
It's already pretty magical. Thanks for the information, I just wasn't sure about the queue thing, and I seem to recall that last time there was a 'surge', people were saying 'oh, i'm 139 in the queue!!' or something like that, like they somehow could know how long it would take for the update to complete.

It's possible, though, that i'm mis-remembering, as i have a terrible memory.

Thanks again!
Flat | Top-Level Comments Only