Problem

We want to release new fixes from the internal twitter-text mirror to GitHub.

Solution

Create a PR and push it out. The PR includes the following changes.

Java

Removed

• Stopped reading data files (JSON) for configuration in order to remove
  heavyweight dependency on Jackson.
• Defaulted configuration to the values in the v3.json files still used
  by the other language implementations.
• Removed proguard configuration since it was about protecting data files
  from obfuscation.

Added

• [emoji] Recognize new gender-neutral sequences from 12.1

Changed

• Updates known gTLDs to recognize recent additions by IANA

JS

Added

• [Lib] New exported function standardizeIndices which adjusts indices based on actual text lengths in order to support characters that are more than one code point long.
• [emoji] Recognize new gender-neutral sequences from 12.1
• [Dev] Upgrade to Babel 7 for transpiling

Fixed

• [Lib] 1️⃣This emoji has not been accurately parse on parseTweet #300 where some numerical emojis are counted as 1 instead of 2 characters
• [Lib] Domains and emails with non-ASCII characters are not hyperlinked #273 Do not identify URLs in the middle of an email address

ObjC

Changed

• Updates known gTLDs to recognize recent additions by IANA (Update gTLDs and conformance tests (March 2020) #308)

Added

• [emoji] Recognize new gender-neutral sequences from 12.1

Ruby

Changed

• Bump nokogiri version (Bump nokogiri from 1.6.3.1 to 1.10.8 in /conformance #302)
• Fix auto-link emoji parsing (Ruby: Fix auto_link so that it doesn't remove emoji #304)
• Updates known gTLDs to recognize recent additions by IANA (Update gTLDs and conformance tests (March 2020) #308)
• Fix warning about has_rdoc usage (Ruby: Remove deprecated has_rdoc call #309)

Added

• [emoji] Recognize new gender-neutral sequences from 12.1