Text segmentation based on context?

Saad asked 11 months ago

The task I’m aiming to achieve is that given some text, how can I segment parts of the text?
So for example lets say I have this text “Peter and Pan were stading in a kitchen talking about their favourite meal, Peter liked something and Pan liked something. They had a nice time engaging in conversation. Peter then went out in the garden and layed down under the sun while Pan was still in the kitchen trying to cook something new for both of them.”
What I want to do is seperate the text into segments so that each segment only refers to one background.
So my above example would give me an output like

  • “Peter and Pan were stading in a kitchen talking about their favourite meal, Peter liked something and Pan liked something. They had a nice time engaging in conversation.” Background 1
  • “Peter then went out in the garden and layed down under the sun” Background 2
  • “while Pan was still in the kitchen trying to cook something new for both of them.” Background 3

It isnt necessary that the text is segmented according to the background. It could be anything like one part has one scene in it and the other part has some other so all the scenes are seperated. Do you know any resources or any research paper that talks about this idea? Any help would be really appreciated 🙂

1 Answers
Chris Staff answered 11 months ago

I think that is a really difficult topic because we require a model to properly recognize context here.
 
Although not exactly what you mean, I think this paper might help you:
Badjatiya, P., Kurisinkel, L. J., Gupta, M., & Varma, V. (2018, March). Attention-based neural text segmentation. In European Conference on Information Retrieval (pp. 180-193). Springer, Cham.