Add TextFeatures transformer for text feature extraction

[ankitlade12]

• Add TextFeatures class to extract features from text columns
• Support for features: char_count, word_count, digit_count, uppercase_count, etc.
• Add comprehensive tests with pytest parametrize
• Add user guide documentation

[solegalli]

Hi @ankitlade12

Thanks a lot!

This transformer, function-wise, I'd say it's ready. I made a few suggestions regarding how to optimize the feature creation functions. Let me know if they make sense.

Other than that, we need the various docs file and we'll be good to go :)

Thanks again!

[solegalli]

We need to rebase main so the 2 remaining tests pass.

[solegalli]

Hi @ankitlade12

I am very sorry for the delayed review. I am travelling till end of April, so I am a bit slower than usual.

I think, for the first version of the transformer, let's enforce the user to pass the names of the text variables. They can pass one or more variables in case there are more than one text column.

Other than that, we need to add the tranformer in the docs/index file, in the readme, and in the docs/api, and adjust the tests and the demo to the newer functionality. Then it is good to merge.

Thank you very much for this great addition.

[ankitlade12]

Hey @solegalli,

I tracked down the cause of the CI failures. They are caused by Pandas 2.2/3.0 breaking changes in the CI environment (specifically datetime string formatting and select_dtypes behavior).

Because these are breaking the entire library (280 failures), they need to be fixed in the main branch first. My
TextFeatures
code works perfectly on the current stable releases and passes all 30 isolated tests. I'd be happy to re-run the CI once the library is updated to handle the new Pandas string/datetime standards."