denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
Denise ([staff profile] denise) wrote in [site community profile] dw_maintenance2017-04-10 05:53 am

The importer is still running, we swear! It's just very busy.

People who are worried because the import of their LiveJournal account has been running for a long time with no real signs of progress: please don't be concerned! The import queue is currently a little long. (In the same way that Mt Everest is a little tall and the Mariana Trench is a little deep.) We're limited in how many import jobs we can run simultaneously and how quickly we can start the next import after one finishes: LiveJournal, like all sites, has restrictions on how frequently we can programmatically request data from their site, so the import queue can get very backed up at times like this when more imports are being started than are finishing. If you look at the import queue and the numbers don't seem to be changing much, or are only going up, it doesn't mean that no imports are finishing: it means a lot of additional people have scheduled an import since the last time you reloaded.

As long as you haven't gotten a failure message in your on-site inbox, your import is still running. (Even if you have gotten a failure message, your import may still be running: if the site thinks that the failure is something that might correct itself, like being unable to connect to the remote site, it will retry for a few times before giving up.) If you have gotten a failure message, the error message in your inbox should tell you what went wrong.

The three common problems right now: 1) you mistyped your username and/or password; 2) you need to agree to LiveJournal's new ToS before they'll permit you to access the data in your account; 3) an entry or entries in your LiveJournal account have a text encoding mismatch and you need to follow the link in the error message to fix it on LJ.

If you haven't gotten a failure message, your import is still waiting in the queue, and will run when it makes its way up to the top of the queue.

People keep asking us how long the queue is (by which they mean, how much time will it take for a job just started to successfully finish: length of time, not number of jobs waiting). I would love to be able to give you a definite answer! It's really, really hard for us to predict how long it will take for a job to get up to the top of the queue, though: how long an import takes to complete depends on a lot of things, including how many posts/comments are in the journal. To give you a ballpark figure that might be off by up to 100% on either side: If I personally started a brand new import right now (in my timezone, the early morning of Monday 10 Apr), I would be pleasantly surprised if it finished before Tuesday morning (24 hours or so), would expect it to finish sometime on Tuesday night or maybe even stretch all the way to Wednesday night (36-60 hours), and wouldn't start to wonder if I should poke [staff profile] mark or [personal profile] alierak to doublecheck that something hadn't gotten stuck in such a way that our monitoring didn't alert us about it until Thursday afternoon or evening (100+ hours).

All of those time estimates, by the way, assume a relatively uncomplicated job that succeeds on the first try. When the site tries again after a failure, it includes a delay that increases after each failure in case the failure was due to transient network issues. So, I know some of you started an import at the end of last week and it's still running: some of you are trying to import very large journals, and some of you ran into errors along the way and are in a retry wait loop. Again: if you haven't gotten the final error message in your inbox (and it will tell you it's the final error), it's still chugging along.

You do not have to leave the importer page open or stay logged into Dreamwidth until your import finishes. (You do have to avoid changing your LJ password until the job is done, or it will fail.) You can close the window/tab and go off and explore Dreamwidth; the movers will be along in a little while with your stuff.

The tl;dr version of my usual longwinded babble: IMPORTER VERY BUSY. MANY PEOPLE MOVING IN. LIKE ON DORM OR APARTMENT MOVE-IN DAY, FREIGHT ELEVATORS VERY SLOW. BUILDING OWNERS RUNNING FREIGHT ELEVATORS AS FAST AS POSSIBLE AND APOLOGIZE FOR THE WAIT.

A housewarming glass of champagne/sparkling cider/fancy handmade soda for all! Welcome to the neighborhood.

EDIT, 10 Apr 2017 7:15PM EDT: the importer is not the only thing that is very busy today! I'm trying to get to all the comments here, but keep getting dragged off to handle other stuff (and will be knocking off for the night soon). If you have a technical support problem, it will probably be faster to open a support request, where there's less likelihood that it will get overlooked in the sea of comments.
upanddisappear: (Default)

[personal profile] upanddisappear 2017-04-10 10:06 am (UTC)(link)
Just as I was checking on my import progress, this is posted! 😊

I completely understand. The queue depth for comments, which I'm waiting on, is currently 752.

💗

(no subject)

[personal profile] upanddisappear - 2017-04-10 10:51 (UTC) - Expand

(no subject)

[personal profile] mmcirvin - 2017-04-10 15:42 (UTC) - Expand
sharpiefan: DW: To boldly go, hoping that the rest of fandom will follow (DW to boldly go)

[personal profile] sharpiefan 2017-04-10 10:24 am (UTC)(link)
DW STAFF VERY COMMUNICATIVE and we LOVE YOU!!!

(I'm not currently importing anything, I deleted my LJ about five years or so ago, but I just wanted to say how much we appreciate you for keeping us in the loop. To those newly arrived from LJ: See! DW staff TALK TO US!! Be excite!)

(no subject)

[personal profile] sharpiefan - 2017-04-10 11:41 (UTC) - Expand

(no subject)

[personal profile] sharpiefan - 2017-04-10 12:37 (UTC) - Expand

(no subject)

[personal profile] mirrorofsmoke - 2017-04-10 17:53 (UTC) - Expand
ersatzkapitaen: Laurence Fox (hey you)

[personal profile] ersatzkapitaen 2017-04-10 10:33 am (UTC)(link)
One of those moving in and I appreciate the update! I'm so glad dw offers the free import in the first place, I'm in no hurry! I don't feel like unpacking my moving boxes until I return from my Easter vacation anyway. ;-)

*leaves a sixpack of beers for the movers for when they arrive with the moving boxes from lj*
Edited 2017-04-10 10:40 (UTC)

(no subject)

[personal profile] mollyc_q - 2017-04-14 06:28 (UTC) - Expand

(no subject)

[staff profile] mark - 2017-04-11 04:22 (UTC) - Expand
beer_good_foamy: (Bernard - black books)

[personal profile] beer_good_foamy 2017-04-10 10:40 am (UTC)(link)
Thanks for reminding us all what it's like to be on a site that actually cares about its users!

(no subject)

[personal profile] beer_good_foamy - 2017-04-10 11:23 (UTC) - Expand

(no subject)

[personal profile] chezmax - 2017-04-10 12:23 (UTC) - Expand

(no subject)

[personal profile] crantz - 2017-04-10 12:38 (UTC) - Expand

(no subject)

[personal profile] soc_puppet - 2017-04-10 15:22 (UTC) - Expand

(no subject)

[personal profile] crantz - 2017-04-11 04:42 (UTC) - Expand

(no subject)

[personal profile] crantz - 2017-04-12 06:31 (UTC) - Expand

(no subject)

[personal profile] kore - 2017-04-10 21:09 (UTC) - Expand

(no subject)

[staff profile] mark - 2017-04-10 21:25 (UTC) - Expand

(no subject)

[personal profile] dewline - 2017-04-10 23:53 (UTC) - Expand

(no subject)

[personal profile] archangelbeth - 2017-04-11 03:38 (UTC) - Expand

(no subject)

[personal profile] burbilog - 2017-04-10 13:09 (UTC) - Expand

(no subject)

[personal profile] burbilog - 2017-04-10 14:52 (UTC) - Expand

(no subject)

[personal profile] burbilog - 2017-04-10 15:15 (UTC) - Expand

(no subject)

[personal profile] veritas_poet - 2017-04-10 20:25 (UTC) - Expand

(no subject)

[personal profile] kore - 2017-04-10 20:35 (UTC) - Expand
cmcmck: (Default)

[personal profile] cmcmck 2017-04-10 10:42 am (UTC)(link)
I've been mentioning to friends transferring that the word needed it just 'persevere'.

Those of us belonging to certain minorities have been left with no choice (although, in truth, I've been based here since 2012).
makamu: (fanfic is by boji)

[personal profile] makamu 2017-04-10 10:43 am (UTC)(link)
I have had a free DW account for years, but after giving up my LJ, I definitely intend to get a paid account as well. Why? Because open communication deserves to be supported :) *tips hat to DW staffers*

(no subject)

[personal profile] amadi - 2017-04-10 22:02 (UTC) - Expand

(no subject)

[personal profile] dryadinthegrove - 2017-04-10 13:32 (UTC) - Expand
madfilkentist: My cat Florestan (gray shorthair) (Default)

[personal profile] madfilkentist 2017-04-10 10:47 am (UTC)(link)
LiveJournal's failure is your success — though I'm sure you wish success wouldn't pile on quite so quickly. :)

(no subject)

[personal profile] enchanted_manit - 2017-04-10 12:38 (UTC) - Expand

(no subject)

[personal profile] brickhousewench - 2017-04-10 13:16 (UTC) - Expand

(no subject)

[personal profile] dewline - 2017-04-11 00:00 (UTC) - Expand

(no subject)

[personal profile] marahmarie - 2017-04-13 13:15 (UTC) - Expand

(no subject)

[personal profile] sharpiefan - 2017-04-10 12:41 (UTC) - Expand

(no subject)

[personal profile] kore - 2017-04-10 20:39 (UTC) - Expand

(no subject)

[personal profile] cmdr_zoom - 2017-04-11 04:13 (UTC) - Expand

(no subject)

[personal profile] kore - 2017-04-11 04:33 (UTC) - Expand

(no subject)

[personal profile] parityanimal - 2017-04-11 14:56 (UTC) - Expand
ironed_orchid: watercolour and pen style sketch of a brown tabby cat curl up with her head looking up at the viewer and her front paw stretched out on the left (Default)

[personal profile] ironed_orchid 2017-04-10 10:59 am (UTC)(link)
For those in the queue: I usually import my comments every 6 months and it takes a few minutes. This week it took 12+ hours. But it got there eventually, and so will yours.

(no subject)

[personal profile] yourlibrarian - 2017-04-10 19:21 (UTC) - Expand

(no subject)

[personal profile] stasia - 2017-04-10 21:53 (UTC) - Expand

(no subject)

[personal profile] stasia - 2017-04-10 22:47 (UTC) - Expand

(no subject)

[personal profile] ironed_orchid - 2017-04-11 00:07 (UTC) - Expand

(no subject)

[personal profile] stasia - 2017-04-11 00:10 (UTC) - Expand

(no subject)

[personal profile] stasia - 2017-04-11 01:40 (UTC) - Expand

(no subject)

[personal profile] soc_puppet - 2017-04-11 02:38 (UTC) - Expand

(no subject)

[personal profile] ursamajor - 2017-04-11 14:21 (UTC) - Expand
rhoste: (Default)

[personal profile] rhoste 2017-04-10 10:59 am (UTC)(link)
Thanks for the update. I'm one of the people in the queue - and have a second journal to bring over when this one's done! - and I can only imagine the laod this is putting on you guys.
yurikhan: (Default)

[personal profile] yurikhan 2017-04-10 11:00 am (UTC)(link)
So, what, has LiveJournal taken their remaining users’ data hostage? Is that even legal? (J/K, pretty sure it’s covered by the old ToS.)
brickhousewench: (Tina Tech Writer)

[personal profile] brickhousewench 2017-04-10 01:19 pm (UTC)(link)
Many APIs throttle how many connections can be made at one time, it's to protect servers and keep the server load somewhat consistent to avoid problems.

In non-tech terms, basically there are only so many exit doors to the LJ building, and we're bunched up waiting for our turn to get to a door.

(no subject)

[personal profile] yurikhan - 2017-04-10 14:28 (UTC) - Expand

(no subject)

[personal profile] yurikhan - 2017-04-10 15:08 (UTC) - Expand

(no subject)

[personal profile] yurikhan - 2017-04-10 15:39 (UTC) - Expand

(no subject)

[personal profile] elialshadowpine - 2017-04-14 11:21 (UTC) - Expand

(no subject)

[personal profile] my_tucker - 2017-04-11 21:42 (UTC) - Expand

(no subject)

[personal profile] brickhousewench - 2017-04-10 15:05 (UTC) - Expand

(no subject)

[personal profile] dragoness_e - 2017-04-11 03:21 (UTC) - Expand

(no subject)

[personal profile] my_tucker - 2017-04-11 01:14 (UTC) - Expand

(no subject)

[personal profile] soc_puppet - 2017-04-11 02:43 (UTC) - Expand

(no subject)

[personal profile] dragoness_e - 2017-04-11 03:24 (UTC) - Expand

(no subject)

[personal profile] cielmelodies - 2017-04-11 04:00 (UTC) - Expand
rafiwinters: (Default)

[personal profile] rafiwinters 2017-04-10 11:12 am (UTC)(link)
Thanks for the update! I'm one of the freshly-imported-from-LJ people. My import didn't, in fact, take much time--guessing I was one of the lucky ones. I appreciate you keeping folks up to date.

I'll take my champagne with Chambord for a nice Kir Royal, thanks.
missroserose: (Default)

[personal profile] missroserose 2017-04-10 01:34 pm (UTC)(link)
From a 2008-era LJ refugee now nicely settled in here, welcome! I'll mix you up that Kir Royale and myself a French 75, and we can get day drunk and read fanfiction!

(no subject)

[personal profile] missroserose - 2017-04-11 03:24 (UTC) - Expand

(no subject)

[personal profile] missroserose - 2017-04-11 03:40 (UTC) - Expand

(no subject)

[personal profile] rafiwinters - 2017-04-10 16:04 (UTC) - Expand

(no subject)

[personal profile] missroserose - 2017-04-11 03:23 (UTC) - Expand

giant nerd

[personal profile] rafiwinters - 2017-04-11 11:05 (UTC) - Expand

Re: giant nerd

[personal profile] missroserose - 2017-04-11 14:19 (UTC) - Expand

welcome home

[personal profile] rafiwinters - 2017-04-10 16:02 (UTC) - Expand
coolohoh: Biohazard (Default)

[personal profile] coolohoh 2017-04-10 11:15 am (UTC)(link)
Newly moved over from LJ, this place sure sounds fun!
asher553: (Default)

[personal profile] asher553 2017-04-10 11:23 am (UTC)(link)
Thanks for the update!
girlfmkitty: (geeky specs)

[personal profile] girlfmkitty 2017-04-10 11:30 am (UTC)(link)
It took the importer for my entries from LJ about 36 hours to complete import, just FYI, guys. Have patience!

(no subject)

[personal profile] girlfmkitty - 2017-04-10 16:47 (UTC) - Expand

(no subject)

[staff profile] mark - 2017-04-11 04:25 (UTC) - Expand
prinzessbtrfly: (Default)

[personal profile] prinzessbtrfly 2017-04-10 11:32 am (UTC)(link)
yes, i have to agree with a few others here that i appreciate you all being so communicative!
dumb questions: i assume we can still post entries while lj is being imported over here or will that cause a problem?
Edited 2017-04-10 11:45 (UTC)
kareila: (Default)

[personal profile] kareila 2017-04-10 02:52 pm (UTC)(link)
No problem - post away!

(no subject)

[personal profile] prinzessbtrfly - 2017-04-11 01:32 (UTC) - Expand
vivdunstan: Part of own photo taken in local university botanic gardens. Tree trunks rise atmospherically, throwing shadows from the sun on the ground. (Default)

[personal profile] vivdunstan 2017-04-10 11:44 am (UTC)(link)
I'm new here too. My LJ import a couple of days ago was in the queue for about 30 hours, but it came out fine in the end, with no errors. Thanks very much for offering this facility, even if I know you must be swamped. I hope to take out a paid account soon.
wildewood: (Default)

import-ant

[personal profile] wildewood 2017-04-10 11:55 am (UTC)(link)
Still waiting for mine to import - I'm guessing this is the busiest week you've had to date, so I'm not holding my breath. 12 hours down, about 24 to go by judging by the upper limit mentioned in comments so far (but judging by friend's updates in other media, LJ will be a wasteland soon enough).

misleading stats (newbyday)

[personal profile] brainwane - 2017-04-10 22:45 (UTC) - Expand
moth2fic: lady with animated moth on cheek (moths_lady)

[personal profile] moth2fic 2017-04-10 11:59 am (UTC)(link)
My gmail folder where I store my account info tells me I've been on DW since 2010 and for most of that time (apart from the first year) I've been a paid member. Really, really impressed with the management - both their efficiency and their approach.

I had, or thought I had, a permanent (paid) account with LJ though I only ever cross post to it and use Scrapbook for hosting pics. But that hostage taking of my account seems illegal to me, as it clearly does to others, whether under US law, Russian, or any other. Still, I suppose people can't risk arguing or they could lose the lot.

Don't worry about being slow. We all understand. Most of us have friends and can explain to them if they're worried.

I'm excited about so many friends finally moving here. We need some kind of site-wide celebration in the near future!!

(no subject)

[personal profile] moth2fic - 2017-04-10 16:07 (UTC) - Expand

(no subject)

[personal profile] sporky_rat - 2017-04-10 16:44 (UTC) - Expand

(no subject)

[personal profile] sporky_rat - 2017-04-10 17:50 (UTC) - Expand

(no subject)

[personal profile] kore - 2017-04-10 20:50 (UTC) - Expand
mewsing: Something shining through the trees (Default)

[personal profile] mewsing 2017-04-10 12:00 pm (UTC)(link)
After being on LJ since December 2002, it felt weird to finally lower the boom and delete it entirely. But that new TOS? No. Just no.

So glad to have made a DW account when I did; thank you SO MUCH for the service to import our content!!

xoxo

(no subject)

[personal profile] mlledesade - 2017-04-14 06:26 (UTC) - Expand
saki101: (Default)

[personal profile] saki101 2017-04-10 12:10 pm (UTC)(link)
My journal is also newly imported. It took three days all told and the screen that showed the status of different elements of the import was very reassuring as the process progressed. It was easy to figure out that an awful lot of people were importing whole journals and communities at the same time, but it's especially nice to hear more of the details, such as the limits LJ sets in accessing. Thank you for creating DW and handling this massive influx.
cmcmck: (Default)

[personal profile] cmcmck 2017-04-10 12:45 pm (UTC)(link)
Ooh! good to see you! I was about to thank you for subscribing to mine- it's locked however so you'll need to do the whole thing to get full access.

(no subject)

[personal profile] saki101 - 2017-04-10 16:45 (UTC) - Expand

(no subject)

[personal profile] saki101 - 2017-04-12 17:38 (UTC) - Expand

(no subject)

[personal profile] sanguinity - 2017-04-12 15:28 (UTC) - Expand

(no subject)

[personal profile] saki101 - 2017-04-12 17:41 (UTC) - Expand

(no subject)

[personal profile] sanguinity - 2017-04-12 18:42 (UTC) - Expand

(no subject)

[personal profile] saki101 - 2017-04-13 11:49 (UTC) - Expand
weaverbird: beadwoven in peyote stitch with 11/0 seed beads (Dreamwidth Logo by Weaverbird)

[personal profile] weaverbird 2017-04-10 12:13 pm (UTC)(link)
Thanks for all the hard work and for keeping us updated on progress!

I decided on Saturday to bring my old LJ over here for safekeeping (the entries are done, comments now in queue yay!) and had to laugh when I saw the length of said queues. Good grief, what an exodus! The housewarming party is going to be ginormous! *begins stockpiling munchies*

(no subject)

[personal profile] weaverbird - 2017-04-11 11:47 (UTC) - Expand

(no subject)

[personal profile] weaverbird - 2017-04-13 13:17 (UTC) - Expand

(no subject)

[personal profile] nav_gato - 2017-04-10 16:47 (UTC) - Expand
mourningdove333: 2011 - my feet - pebbles and stones - the ocean - Holy Rood, Newfoundland (Default)

[personal profile] mourningdove333 2017-04-10 12:18 pm (UTC)(link)
Thank you for letting us know! My journal entries are currently in the process of being imported from LJ. Is it possible to "subscribe" to journals that are on LiveJournal and to "grant access" to LJ friends through Dreamwidth? I tried to do this with several of my friends but haven't seen their journal entries on my "Reading" page here yet.
rmc28: Rachel in hockey gear on the frozen fen at Upware, near Cambridge (Default)

[personal profile] rmc28 2017-04-10 12:34 pm (UTC)(link)
You can subscribe to the feeds from LiveJournal accounts and have them appear in your Reading page, but I think that will be public entries only.

When you import your LJ friends, they are given an OpenID to which you can grant access. In addition, if they also have a Dreamwidth account, they can claim their generated OpenID and link it to their Dreamwidth identity (if they want).

More information here: where to find LiveJournal feeds: http://www.livejournal.com/support/faq/149.html

All about subscribing to feeds, OpenIDs, etc
https://www.dreamwidth.org/support/faqbrowse?faqcat=othersites

(no subject)

[personal profile] ranunculus - 2017-04-10 15:36 (UTC) - Expand

(no subject)

[personal profile] sporky_rat - 2017-04-10 16:47 (UTC) - Expand

(no subject)

[personal profile] ranunculus - 2017-04-10 16:57 (UTC) - Expand

(no subject)

[personal profile] ranunculus - 2017-04-10 17:09 (UTC) - Expand

(no subject)

[personal profile] saphirablue - 2017-04-11 19:52 (UTC) - Expand

(no subject)

[personal profile] saphirablue - 2017-04-15 16:15 (UTC) - Expand

(no subject)

[personal profile] saphirablue - 2017-04-16 10:41 (UTC) - Expand

(no subject)

[personal profile] soc_puppet - 2017-04-10 15:45 (UTC) - Expand

(no subject)

[personal profile] mourningdove333 - 2017-04-11 02:32 (UTC) - Expand

(no subject)

[personal profile] pebblerocker - 2017-04-11 03:28 (UTC) - Expand

(no subject)

[personal profile] pebblerocker - 2017-04-11 08:01 (UTC) - Expand
stageira: (West Wing - Watching!)

[personal profile] stageira 2017-04-10 12:20 pm (UTC)(link)
I actually feel guilty over this! I had my import done early on, but then I decided to check my old old old entries and I realized that everything was a triplicate *headesk* That was a lot of entries to fix, so I deleted everything and started a new import??? Ops?

Virtual chocolate and cafeine to all!!!

(no subject)

[personal profile] stageira - 2017-04-11 10:39 (UTC) - Expand
notabler: (Default)

[personal profile] notabler 2017-04-10 12:21 pm (UTC)(link)
Thank you very much for your hard work
monanotlisa: symbol, image, ttrpg, party, pun about rolling dice and getting rolling (Default)

[personal profile] monanotlisa 2017-04-10 12:23 pm (UTC)(link)
<3

(no subject)

[personal profile] monanotlisa - 2017-04-10 17:11 (UTC) - Expand

Page 1 of 6