karzilla: a green fist above the word SMASH! (Default)
[staff profile] karzilla2015-11-22 07:32 pm

code push done!

We're updating the site momentarily! Once the dust settles, please let us know if anything isn't working as expected. I'll edit the entry here if we confirm any issues.

Update, 21:45: All done!
karzilla: a green fist above the word SMASH! (Default)
[staff profile] karzilla2015-11-22 01:03 pm

Code push!

We are planning to do a code push in about six hours, around 5pm Pacific time.

Most of the changes with this push are cleanup and small backend fixes, but we also have a new journal style called "Pattern" with 24 themes for you to choose from, and most excitingly, QuickReply has now been enabled for journal, day, and network views.

We'll update again to let you know when the code push is in progress!
alierak: (Default)
[personal profile] alierak2015-09-23 10:35 am

Whoops!

Please accept our apologies if the site was down or responding slowly while you were trying to use it earlier. Several of our servers rebooted unexpectedly, and I've opened a ticket with the hosting company to ask what's going on. As best I can tell everything's working normally now.
karzilla: a green fist above the word SMASH! (Default)
[staff profile] karzilla2015-08-29 10:00 pm

Code push done!

We're updating the site momentarily! Once the dust settles, please let us know if anything isn't working as expected. I'll edit the entry here if we confirm any issues.

Update, 22:30: We've been done for about 30 minutes and haven't seen any issues, so please go ahead and let us know if you notice any problems!
karzilla: a green fist above the word SMASH! (Default)
[staff profile] karzilla2015-08-29 01:12 pm

Code push!

[staff profile] mark and I are planning to do a code push tonight! We will start working around 7pm Pacific time but since it's my first time, the actual push to the site probably won't happen until closer to 8pm Pacific time.

Here's a partial list of changes that will go live with this push:

  • Rename swaps will accept rename tokens purchased on either account.

  • OpenID community maintainers will be able to edit tags on community entries.

  • Adorable new mood theme called "angelikitten's Big Eyes".

  • Username tag support for lj.rossia.org.

  • Embedded content support for screen.yahoo.com and zippcast.com.

  • Additional space on the user profile page to list your Github username.


And as usual, many tweaks, small bugfixes, and the occasional page source rewrite.

We'll update again to let you know when the code push is in progress!
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-06-25 09:20 pm

Code push!

We will be performing tonight's code push in a few minutes. There'll be a brief downtime, but not longer than a few minutes. (Ideally, that is.)

I'll update this entry when we're back, and people can report issues here.

EDIT: New code is live! Please report any issues here.

We're currently having an issue with the image proxy for accessing the site via HTTPS -- images are currently failing to load. We'll have that fixed as soon as we can.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-06-25 01:48 am

Code push Thursday

We are currently planning a code push for about 18 hours from now (the night of Thursday 25 June). We'll probably begin around 9PM Pacific time, although it might be a bit later. As always, we'll update here and our Twitter offsite status when we begin.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-03-16 12:27 am

(no subject)

Tonight's code push is now complete! As always, please report any issues here.

(We're particularly interested in issues with HTTPS browsing; we're getting closer to ironing out all the bugs, but we know it's still not perfect.)

EDIT: If you're not getting the inline reply form -- if you're getting redirected to another page to comment -- please clear your cache and then restart your browser.

PLEASE NOTE: If you're coming to report an entry in your journal not displaying properly, and there's a <table> in the entry (or you're reporting a problem with your journal displaying properly and there's an entry with a <table> somewhere visible on the page): please check the entry's source and make sure the HTML of the table is constructed properly. We've made a change to our HTML cleaner to be more strict about missing tags and tags that were closed in a different order than they were opened. Most of the display problems people have reported have been because a table in an entry was missing closing </td>/</tr>tags!
fu: Close-up of Fu, bringing a scoop of water to her mouth (Default)
[personal profile] fu2015-03-14 06:12 pm

Code push scheduled in ~24 hours (Sunday/Monday)

FYI -- We're scheduling a code push for Sunday 9PM PDT / Monday 12AM EDT / 4AM GMT.

Should be fun! We'll have another post up when we're about to start.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-02-27 11:30 pm

(no subject)

If you're seeing slow page load times, pages not fully loading, missing icons, 'naked' pages (the text of the page only, without any styling, etc): please shift-refresh your browser, clear your browser cache, and then just hang tight. We're switching CDN providers, so your browser may have cached the wrong copy of things.

If the problem hasn't cleared up by tomorrow, then let us know and we'll look into it further!
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-02-05 05:46 am

Email issues to Hotmail continue, joined by issues to Yahoo

For the past week and a half or so, Hotmail has been rejecting all email from us. Sadly, Yahoo has now joined them. This means that if your confirmed email address is @hotmail.com or @yahoo.com, you won't get any email from Dreamwidth at all. (This includes comment notification emails, password reset emails, lost username emails, confirmations/receipts for payments, email from your @dreamwidth.org forwarding address ... basically, if it's email and it's from us, it won't reach you.)

This is a block at the system level, so there isn't anything you can do to work around it. It's not due to spam filters on your individual account, so whitelisting Dreamwidth in your mail application won't work to fix things this time: these providers are blocking all mail from us, across the board. When a provider makes that kind of block, they don't discuss the exact reasons that led to the blocking, but our best guess is that it's due to a combination of the amount of email we send out (especially email with highly similar subject lines and content, since -- for instance -- a notification of a new comment to an entry quotes the entry) and an uptick in the amount of spam sent to @dreamwidth.org forwarding email addresses, since that forwarded spam can look like we were the ones to send it.

We've gone through the process to request unblocking from the providers directly, but haven't seen any progress there yet. We are, however, actively working on alternate solutions that will reduce the risk of us being identified as spammers in the future -- we ran the first test yesterday and results are looking promising. We'll keep you posted on the progress.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-01-18 03:48 am

Code push finished, fixing immediate bugs now

We've finished pushing the new code and will be working on fixing immediately obvious bugs now!

We're looking into problems with the new Create/Edit entries page not working properly on Chrome.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-01-18 08:21 pm

(no subject)

We are (inevitably) running a little bit late -- the code push will begin in about half an hour or so. We'll update this entry when we're beginning.

This code push contains some rewrites/conversions of various pages on the site, so things will look a little different than what you're used to. The most obvious change will probably be to the Create Entry page -- it's not a redesign, and things will continue to behave the exact same way they have been, they'll just look a little bit different. Do not adjust the horizontal, do not adjust the vertical.

EDIT: Sorry, [staff profile] mark got started before I could update! We are in the middle of pushing now.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2015-01-16 06:28 pm

Code push on Saturday/Sunday

We will be doing a code push this weekend! [staff profile] mark, [personal profile] fu, and I are in New Zealand for Linux Conf AU, so the code push is planned for Sunday, 18 January, at 8PM New Zealand time (GMT +13). (See this in your time zone.) This is Sunday 2AM EST/7AM GMT/Saturday 11PM PDT.

We'll update you again right before we're ready to get started.
fu: Close-up of Fu, bringing a scoop of water to her mouth (Default)
[personal profile] fu2015-01-03 08:20 am

Captcha issues

We had some issues with our captcha earlier today which prevented people from making new accounts and prevented some comments from being posted.

We've fixed things, and we're contacting our captcha provider to make sure we don't run into this again in the future.

Thanks all for your patience! And lots of thanks to everyone who reported the issue and all our support people who made sure we developers knew something was up. If you notice any further weirdness, please open a support request and we'll look into it.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2014-12-01 01:37 pm

(no subject)

We're having some trouble with our payment system today -- our payment processor is telling us that we have an invalid merchant ID for some reason. (They've recently switched owners and are having some difficulty integrating their systems.)

I'll be checking in with them and seeing what's up. Sorry about the inconvenience!

EDIT, 2:21PM EST: Payments should be fixed in half an hour to an hour. (Turns out we had to update some information about our payment processor with our payment gateway.) I'll update again when our payment gateway confirms that things are back to good.

EDIT, 3PM EST: Our payment gateway has confirmed that everything's back to normal now. Thanks for your patience, all! I'm sorry about the hassle.
mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark2014-10-14 05:38 pm

Upgrading against the POODLE vulnerability

Hi all,

Today another SSL vulnerability was announced. This one is named POODLE and is, while serious, much less serious than the Heartbleed event from some months ago.

Unfortunately, the only real way to fix the problem is to disable something called "SSLv3" entirely. Basically, this means that we instruct our servers that they are no longer allowed to speak version 3 of the SSL protocol (you can think of it as a language -- we ban this language from our servers). It turns out this is generally OK since most browsers don't actually speak using SSLv3 these days -- you actually use what's called TLS, which is a more modern, better way of protecting the stuff you send across the Internet.

The SSLv3 protocol is actually around 15 years old at this point, and TLS has been out so long that nearly every browser out there supports it. However, shutting off SSLv3 does mean that very old browsers -- IE6, for one -- can no longer talk to Dreamwidth using encryption. In this case, since the encryption wouldn't actually mean anything, we think it's better to not even pretend that it works.

I will be making this change sometime in the next hour or three. This really should impact almost none of you, but there might be one or two and, in that case, I'm sorry. We think it's better to do this so you know you're not actually secure than to let Dreamwidth pretend to be secure.

Edit: This has been deployed. SSLv3 is disabled on Dreamwidth.

Comments and questions welcome, as always!

mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark2014-09-04 02:14 pm

DNS change today

Hi all,

We had a brief outage this morning. The cause was an (unexpected) policy change by our DNS provider, Dyn, deciding to shut us off. They had to roll back the change for unrelated reasons so we were back online, but it does mean that we need to migrate off of their service.

ETA: The policy change was that, for about 10 years now -- as long as I've been using Dyn! -- they had no usage/quota limits on their DNS service. Given that DNS requests are tiny and easy to serve, this made sense. They made a business decision recently to establish some (rather tiny) quotas. We're ... quite in excess of them (by some 15,000%) and we don't want to pay in excess of $500 USD/month for DNS service. Amazon's price is 10% of that. They probably tried to contact us, but I don't recall seeing any emails. Anyway, that's it; it's nothing particularly nefarious.

We will be moving our DNS service to Amazon's Route53 service. This kind of migration is fairly easy technically, but if there are problems it will probably mean Dreamwidth will be offline until they can be resolved. And, given the nature of how DNS works, it means that any outage will probably be measured in hours rather than minutes.

I've done my best to ensure that the changeover will go smoothly. If anything happens, though, we'll be on our [twitter.com profile] dreamwidth account to keep everybody apprised of the progress.

The switch will be flipped around 3:30pm PDT / 2230 UTC today, this is in about 90 minutes.

denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2014-08-12 12:20 pm

(no subject)

Some people are reporting having trouble reaching the site, especially from the UK/EU. Unfortunately, after looking into it, it seems to be an internet routing problem and not something we can fix on our end. Hang tight; our hosting service is pretty good at working around those sorts of problems pretty quickly.
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
[staff profile] denise2014-08-10 11:53 pm

(no subject)

We'll be starting the code push relatively soon; there may be a few blips here and there as we work. I'll update this post when it's all finished!

EDIT: Code has been pushed. Let us know if you encounter any problems! A list of the (many) bugfixes included in this push will be forthcoming.