Readimg through this thread, it seems likely is a KV cache "bug". Theyre likely doing too many evictions of the LLM cache so the context is being reloaded to often.
Its a "bug" because its probably an intended effect of capturing the costs of compute but surfacing a fact that they oversold compute to a situations where they cant keep the KV cache hot and now its thrashing.
So, think of it as a business man: You don't really care if your customers swear or whatever, but you know that it'll generate bad headlines. So you gotta do something. Just like a door lock isn't designed for a master criminal, you don't need to design your filter for some master swearer; no, you design it good enough that it gives the impression that further tries are futile.
So yeah, you do what's less intesive to the cpu, but also, you do what's enough to prevent the majority of the concerns where a screenshot or log ends up showing blatant "unmoral" behavior.
The up-side of the US market is (almost) everyone there speaks English. The down side is, that includes all the well-networked pearl-clutchers. Europe (including France) will have the same people, but it's harder to coordinate a network of pearl-clutching between some saying "Il faut protéger nos enfants de cette vulgarité!" and others saying "Η τηλεόραση και τα μέσα ενημέρωσης διαστρεβλώνουν τις αξίες μας!" even when they care about the exact same media.
For headlines, that's enough.
For what's behind the pearl-clutching, for what leads to the headlines pandering to them being worth writing, I agree with everyone else on this thread saying a simple word list is weird and probably pointless. Not just for false-negatives, but also false-positives: the Latin influence on many European languages leads to one very big politically-incorrect-in-the-USA problem for all the EU products talking about anything "black" (which includes what's printed on some brands of dark chocolate, one of which I saw in Hungary even though Hungarian isn't a Latin language but an Ugric language and only takes influences from Latin).
I just went through quite an adventure trying to translate back and forth from/to Hungarian to/from different languages to figure out which Hungarian word you meant, and arrived at the conclusion that this language is encrypted against human comprehension.
dark chocolate is "étcsokoládé" literally edible-chocolate in Hungarian.
i heared the throat-cleaning "Negró" candy (marketed by a chimney sweeper man with soot-covered face) was usually which hurt English-speaking people's self-deprecating sensitivities.
At some point, there's going to be a dumbenough general to try to paratrooper their way in. They've spent the past year trying to cull "dysloyal" troops, so at some point, the delusion will surface is an absurdly dumb attempt.
US forces are not partisan and not culled, they're mostly the same entity they were last year, but with a few Generals asked to retire.
(Edit: highly professional I might add. There are quirks, and obvious hints of 'nationalist bias' - but that's to be expected. They are not the 'cultural problem' we see on the news - at least not for now. They lean 'normal')
The current Joint Chiefs is a bit obsequious but he's not crazy.
These are very sane people, for the most part.
They may be pressed to do something risky, like land troops at Kharg island, but not completely suicidal.
That 'risk' may entail getting a number of soldiers captured, but that's not on the extreme side of military failure, it's mostly geopolitical failure. It would certainly end DJT as a popular movement.
Having a ship hit, or a few soldiers captured - and this sounds morose - is normal. That's why they exist. It's the political fallout that's deadly.
They won't do anything to crazy. The craziest thing they could do is 'full invasion' and Congress won't allow that. It's very unpopular and DJT has populist instinct as well - he's trying to 'find a way out'.
- So I meant militarily. Yes - you're right, they could totally do something as stupid as attack civilian infrastructure. I totally buy that.
- Congress is in charge. First - they need budget, and the GOP majority has zero appetiate for approving this.
Remember that most of the GOP dislike Trump, and they also don't like this war, it's risky to the US - and - their own jobs.
So the GOP finds ways to 'resit' Trump without sticking their neck out. They do this collectively by grumbling and not passing legislation.
The majority leaders tell Trump 'We just don't have the votes for it!' thereby not taking a position against Trump, more or less 'blaming the ghosts in the party' kind of thing.
That's very different than passing legislation that reels Trump in, that's 'active defiance'.
So by 'passive defiance' and not approving $, the majority holds the Admin back.
Remember that nobody wants this, not the VP, not Rubio. Hegseth is a 'TV Entertainer'. The Defence Establishment and Intelligence Establishment knows this is stupid. 80% of Congress wants it over now.
If DJT has 65% poularity and 75% for the war, the equation would tilt, but as it stands, there is not enough political momentum.
But anything could happen ...
The death or capture of US soldiers could strongly evoke people to move one way or the other.
I'm a former service member (of another country) and I have family members in the US forces.
I'm paying relatively close attention.
Just FYI, US forces are enormous, and with a very long and institutionalized history, and it would take at least decade to tilt them in such a manner, moreover, it's not even happening in the way you're insinuating.
Removing certain DEI polices will have a very marginal affect on anything but senior officer promotions, as US forces are very meritocratic in most ways already.
Removing transgender personnel etc. is arguably unfair in many ways - but will have absolutely zero effect on those institutions overall. None.
Nobody is getting 'retired' for not being sufficiently MAGA, other than a few select positions in Washington.
Your comment is uninformed and unwelcome; you'll have to do a bit better than consume Reddit in order to gain actual knowledge and perspective, and save yourself the embarrassment.
Military does as the Civilian leadership orders them to, there is no other way in the west, and if the civilian leadership demands that they want an ground invasion, then they'll get one, even if it's the most moronic waste of human life in the world.
It's true that 'civilians are in charge' but it would be an oversimplification to suggest that the military will just 'do what they are asked'.
Civilian leadership takes a few forms, there is a division between the powers of Executive and Congress. The military won't pursue anything long term without the backing of both.
There are a lot of legal thresholds, Congressional approval being just one of them.
There is institutional incumbency, and the military will push back extremely hard on things that it deems impossible, or excessively risky.
Populism etc. etc..
There are so many factors.
If they want to mount a risky 500 000 person invasion of Iran, they'll have to do a lot of 'convincing' and get a lot of buy in from stake holders. There is no chance that the Executive count mount that kind of operation without a lot of institutional buy in.
is china helping ukraine also? The real "force multiplier" is basically the same as it was 100 years ago: fancy advanced tech works great to clear large, unoccupied spaces with no terrain costs; it still won't go into a jungle, climbmountains or fight in the streats.
Whats compounding existing reality, is how cheap it is to use commercial tech from any of these manufacturing hubs, china included, and turn it into a small but persistent offensive weapon.
So now Americas got billions of dollars worth of ammo up agains millions of dollars worth of fodder, and that won't clear the way to controlling a large, well defended plot of land.
America's leaders are drunk and high on their own propaganda, even while Ukraine has demonstrated just how useless the old, bulky and costly tech is.
As someone says, don’t interrupt a rival when they are making a mistake. China can gain quite a lot by just waiting on the side lines, contributing as much as they can get away with while still looking reasonable (which is quite easy, when the other protagonists are Putin, Trump, or Khamenei jr).
reply