[BUG]: Web scraper stage produces output which cannot be consumed by cudf.

[cwharris]

Version

fea-sherlock

Which installation method(s) does this occur on?

No response

Describe the bug.

The WebScraperStage produces output that cannot be consumed by cudf, so downstream stages must continue to use Pandas or remove the offending columns.

Morpheus/examples/llm/common/web_scraper_stage.py

Lines 149 to 150 in d7138cc

	# Not using cudf to avoid error: pyarrow.lib.ArrowInvalid: cannot mix list and non-list, non-null values
	return MessageMeta(pd.DataFrame(final_rows))

Instead, the WebScraperStage should produce output that can be consumed by cudf.

Minimum reproducible example

No response

Relevant log output

Click here to see error details

[Paste the error here, it will be hidden by default]

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

• I agree to follow Morpheus' Code of Conduct
• I have searched the open bugs and have found no duplicates for this bug report