We're about to pull the lever on tonight's code push! Many of the changes we are making to the site are under-the-hood improvements, but these are the ones you are more likely to notice:
- New account setting option for RP accounts, for future feature development.
- Many more sites upgraded to use HTTPS links instead of relying on our SSL proxy.
- Moved the Manage Icons page to /manage/icons and modernized the underlying code.
- Increased the size limit for icon descriptions from 120 to 300 characters.
- Various requested fixes for the image upload/management pages.
- Improved processing of emailed entries for changes to entry security.
- Improved processing of emailed comments for removal of quoted text.
- Reading page with date filter now has previous / next day links.
- Banned users hidden by default on the Manage Circle page.
- Most importer failure messages will now include the name of the journal being imported, for the benefit of users running multiple imports.
- People who read the RSS/Atom feed of your journal will see correct entry links and embedded content.
- Whitelist embeds from: coub.com, airtable.com, mixcloud.com
- New <user> tag sites: medium.com, imzy.com, facebook.com, instagram.com
- New "other site" fields on user profiles: Imzy, Instagram
Once the code push starts, you may notice that the site is slow to respond, but it should remain available to use unless something goes badly wrong.
I'll update this post when the code push is finished. Stay tuned!
Update: All done! Let us know if anything seems more wrong than usual!
I don't have a list of changes for you yet, but most will fall into the following categories: things users have complained about to support volunteers, things support volunteers have complained about to developers, things denise has complained about not working the way she expects them to (and as we all know, The Boss is Always Right), and things that were printing warnings over and over in the production server logs, making it hard to spot when less frequent, more urgent errors were being printed. Oh, and also all the unused code I ripped out at the roots, which if you notice that, I did it wrong.
To sum up: we are rolling out a bunch of requested changes, so thank you all for your feedback!
If you're new to Dreamwidth and interested in tracking our development process, our commit logs are published to changelog and changelog_digest, and every month or so, one of our volunteers will translate those often-cryptic entries into witty, informative code tours! The most recent one was published on April 1, so we're about due for a new one. Hint, hint.
We'll update here again to let you know when the code push is imminent!
If you tried to schedule a second import while the first one was still running, at any time in the past 10 days or so, you may have confused the poor thing. If you think your import should be finished by now and it isn't, and you're seeing "Aborted" on the Importer Status part of the Importer page, feel free to open a support request in the Importer category and we'll look into it for you. (It may take a little bit before you get a response; those of us who have the access to look into importer problems have been really busy for the past two weeks or so, and I at least need a few days to catch my breath a bit before diving back into the fray! But we'll do what we can.)
I hope all y'all are continuing to settle in well to your new home!
As long as you haven't gotten a failure message in your on-site inbox, your import is still running. (Even if you have gotten a failure message, your import may still be running: if the site thinks that the failure is something that might correct itself, like being unable to connect to the remote site, it will retry for a few times before giving up.) If you have gotten a failure message, the error message in your inbox should tell you what went wrong.
The three common problems right now: 1) you mistyped your username and/or password; 2) you need to agree to LiveJournal's new ToS before they'll permit you to access the data in your account; 3) an entry or entries in your LiveJournal account have a text encoding mismatch and you need to follow the link in the error message to fix it on LJ.
If you haven't gotten a failure message, your import is still waiting in the queue, and will run when it makes its way up to the top of the queue.
People keep asking us how long the queue is (by which they mean, how much time will it take for a job just started to successfully finish: length of time, not number of jobs waiting). I would love to be able to give you a definite answer! It's really, really hard for us to predict how long it will take for a job to get up to the top of the queue, though: how long an import takes to complete depends on a lot of things, including how many posts/comments are in the journal. To give you a ballpark figure that might be off by up to 100% on either side: If I personally started a brand new import right now (in my timezone, the early morning of Monday 10 Apr), I would be pleasantly surprised if it finished before Tuesday morning (24 hours or so), would expect it to finish sometime on Tuesday night or maybe even stretch all the way to Wednesday night (36-60 hours), and wouldn't start to wonder if I should poke mark or alierak to doublecheck that something hadn't gotten stuck in such a way that our monitoring didn't alert us about it until Thursday afternoon or evening (100+ hours).
All of those time estimates, by the way, assume a relatively uncomplicated job that succeeds on the first try. When the site tries again after a failure, it includes a delay that increases after each failure in case the failure was due to transient network issues. So, I know some of you started an import at the end of last week and it's still running: some of you are trying to import very large journals, and some of you ran into errors along the way and are in a retry wait loop. Again: if you haven't gotten the final error message in your inbox (and it will tell you it's the final error), it's still chugging along.
You do not have to leave the importer page open or stay logged into Dreamwidth until your import finishes. (You do have to avoid changing your LJ password until the job is done, or it will fail.) You can close the window/tab and go off and explore Dreamwidth; the movers will be along in a little while with your stuff.
The tl;dr version of my usual longwinded babble: IMPORTER VERY BUSY. MANY PEOPLE MOVING IN. LIKE ON DORM OR APARTMENT MOVE-IN DAY, FREIGHT ELEVATORS VERY SLOW. BUILDING OWNERS RUNNING FREIGHT ELEVATORS AS FAST AS POSSIBLE AND APOLOGIZE FOR THE WAIT.
A housewarming glass of champagne/sparkling cider/fancy handmade soda for all! Welcome to the neighborhood.
EDIT, 10 Apr 2017 7:15PM EDT: the importer is not the only thing that is very busy today! I'm trying to get to all the comments here, but keep getting dragged off to handle other stuff (and will be knocking off for the night soon). If you have a technical support problem, it will probably be faster to open a support request, where there's less likelihood that it will get overlooked in the sea of comments.
If you continue to have issues, make sure you're not using HTTPS Photobucket links. It's a bit counterintuitive, but if you use HTTP instead, it will be automatically transformed on our end to an HTTPS link that uses p.dreamwidth.org.
Hope that clears everything up for now! Let us know if it doesn't...
Good luck to squeaky with the recovery!
We've had people ask us about the Cloudflare leak reported a few days ago. We are Cloudflare customers, and it is possible that login cookies or passwords may have been exposed as part of the incident. We believe the risk to you is relatively low -- it was a small percentage of Cloudflare's requests that were involved over a relatively short period of time, and we haven't found any evidence that anything from us was among them. This is not an absolute guarantee that none of your accounts were affected, but we don't think the likelihood is very high.
Because we believe the risk to be low, we aren't automatically expiring everyone's session cookies and requiring you to log back in and change your password -- whenever we do that, it does lock some people who they can't remember their passwords and no longer have access to their confirmed email addresses out of their accounts, and we believe that will affect more people in this case.
Still, it's always a good idea to change your passwords regularly, and now would be a good time to do it, especially if you want peace of mind. We have a FAQ on how to change your password. If your browser logs you in automatically and you don't remember your password, you can reset it. If you've forgotten your password and no longer have access to your most recent confirmed email address, you can have the password reset email sent to any email address you've confirmed on your account by entering both your username and your old email address at the Lost Info page.
Unfortunately, if you've forgotten your password and no longer have access to any email address you've confirmed on your account, you probably won't be able to reset your password. In some cases, if you've previously paid for your account, we can validate your payment details to confirm your identity and reset your password. If you can't reset your password, but think you may have paid for your account in the past, you can open a support request in the Account Payments category and I'll check into it for you.
LiveJournal has temporarily blocked
EDIT 26 Feb noon EST: LJ unblocked and whitelisted us this morning, so all is working again!
Here's a partial list of changes that will go live with this push, apart from the usual minor tweaks and bugfixes:
- HTTPS Everywhere beta! Users can opt-in to have all Dreamwidth content automatically served over HTTPS. We'll post the instructions for this after the feature goes live.
- New and improved design for the file management pages, which we were hiding from you because we were so embarrassed about them before. Thanks to momijizukamori for making them prettier and more functional!
- Backend fixes to resolve problems using the aforementioned file management pages. (Did I already mention the embarrassment?)
- At long last, international character support for journal search! Our systems guru alierak finally cracked this long-standing bug.
- Support index page converted to Foundation styling, for your mobile viewing pleasure.
- For users of the Practicality style: color properties now sort properly in the customization wizard.
- For users of the Drifting style: the QuickReply box will now appear in the appropriate location, instead of wandering off somewhere unexpected.
- Improved handling of word break (<wbr>) elements in user entries.
- Allow embeds from: Facebook, CNN, 4shared.com, playmoss.com, onedrive.com, jsfiddle.net, scratch.mit.edu
We'll update again to let you know when the code push is in progress!
Sorry for the 'Welcome to nginx!' issues we've been seeing for a bit now. It was a server configuration issue that hit us when a webserver rebooted.
Basically when the machine rebooted, nginx (software that can act as a web server) started up and then when Apache (the software Dreamwidth code uses for a web server) tried to start, it failed because nginx had already started and registered on the ports (the way web server software gets your requests).
Again, sorry for the site issues. Everything should be back to happy-times now, so let us know if you see any issues!
Site performance may continue to be rocky on and off for the next few days until we get everything tuned the way it needs to be tuned -- thank you for your patience!
The site may occasionally be slow to respond or have trouble connecting as we tune servers and databases, or you may receive Gateway Timeout errors.
Comment notification emails may be delayed due to database load.
Inbound email (post-by-email and comment-by-email) may be delayed for a bit while your outgoing mail server catches up with the switch.
Email sent to your email@example.com address may be more likely to be marked as spam, due to our mail server changing its IP address.
The site search database may be missing entries and comments and will catch up over the next few days, as database load allows. Entries and comments posted since the site came back up will be added to the index as they're posted.
Logging into other sites using your Dreamwidth OpenID is working again! Yay!
Loading embedded content over secure connections should be fixed!
There is a known problem with trying to rearrange elements on the Beta Update page because a script element isn't loading properly. Update: This should be fixed now!
Let us know if you see anything else odd with the site that isn't listed here!
Things you don't need to tell us about:
* The site may look a little weird or naked for a while as your computer/network/ISP/etc catches up with the switch.
* Comment notification emails should be going out properly, but inbound email (post-by-email and comment-by-email) may be delayed for a bit while your outgoing mail server catches up with the switch.
* The site search database is a few days out of date (missing entries from the past two days) and will catch up over the next few days. Entries and comments posted since the site came back up will be added to the index when they're posted.
* Accessing the site will be slow for a while as the caches warm back up, and you may receive Gateway Timeout errors.
* Due to the occasional database connection problem due to high load and site slowness earlier, some comments did not generate emailed notifications and those notifications can't be re-sent. New comments made since we resolved the DB problems are generating email notifications, but slowly (due to the general database slowness).
* Logging in to other sites using your Dreamwidth OpenID is broken (& we'll fix it as soon as we can!)
Let us know if you see anything else weird!
We'll remind you Wednesday night, and again when the site is going into maintenance mode.